Nov 15 12:43:30 user nova-compute[75813]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75813) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 12:43:30 user nova-compute[75813]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75813) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 12:43:30 user nova-compute[75813]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75813) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 12:43:30 user nova-compute[75813]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:43:31 user nova-compute[75813]: INFO nova.virt.driver [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 12:43:31 user nova-compute[75813]: INFO nova.compute.provider_config [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] Acquiring lock "singleton_lock" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] Acquired lock "singleton_lock" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] Releasing lock "singleton_lock" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] Full set of CONF: {{(pid=75813) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ******************************************************************************** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] Configuration options gathered from: {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ================================================================================ {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] allow_resize_to_same_host      = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] arq_binding_timeout            = 300 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] backdoor_port                  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] backdoor_socket                = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] block_device_allocate_retries  = 300 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] block_device_allocate_retries_interval = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cert                           = self.pem {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute_monitors               = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] config_dir                     = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] config_drive_format            = iso9660 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] config_source                  = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] console_host                   = user {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] control_exchange               = nova {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cpu_allocation_ratio           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] daemon                         = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] debug                          = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] default_access_ip_network_name = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] default_availability_zone      = nova {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] default_ephemeral_format       = ext4 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] default_green_pool_size        = 1000 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] default_schedule_zone          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] disk_allocation_ratio          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] enable_new_services            = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] enabled_apis                   = ['osapi_compute'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] enabled_ssl_apis               = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] flat_injected                  = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] force_config_drive             = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] force_raw_images               = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] graceful_shutdown_timeout      = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] heal_instance_info_cache_interval = 60 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] host                           = user {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] instance_build_timeout         = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] instance_delete_interval       = 300 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] instance_format                = [instance: %(uuid)s]  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] instance_name_template         = instance-%08x {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] instance_usage_audit           = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] instance_usage_audit_period    = month {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] internal_service_availability_zone = internal {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] key                            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] live_migration_retry_count     = 30 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] log_config_append              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] log_dir                        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] log_file                       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] log_options                    = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] log_rotate_interval            = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] log_rotate_interval_type       = days {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] log_rotation_type              = none {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] long_rpc_timeout               = 1800 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] max_concurrent_builds          = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] max_concurrent_live_migrations = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] max_concurrent_snapshots       = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] max_local_block_devices        = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] max_logfile_count              = 30 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] max_logfile_size_mb            = 200 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] maximum_instance_delete_attempts = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] metadata_listen                = 0.0.0.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] metadata_listen_port           = 8775 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] metadata_workers               = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] migrate_max_retries            = -1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] mkisofs_cmd                    = genisoimage {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] my_ip                          = 10.0.0.210 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] network_allocate_retries       = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] osapi_compute_listen_port      = 8774 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] osapi_compute_unique_server_name_scope =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] osapi_compute_workers          = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] password_length                = 12 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] periodic_enable                = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] periodic_fuzzy_delay           = 60 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] pointer_model                  = ps2mouse {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] preallocate_images             = none {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] publish_errors                 = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] pybasedir                      = /opt/stack/nova {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ram_allocation_ratio           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] rate_limit_burst               = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] rate_limit_except_level        = CRITICAL {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] rate_limit_interval            = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] reboot_timeout                 = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] reclaim_instance_interval      = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] record                         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] reimage_timeout_per_gb         = 60 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] report_interval                = 120 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] rescue_timeout                 = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] reserved_host_cpus             = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] reserved_host_disk_mb          = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] reserved_host_memory_mb        = 512 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] reserved_huge_pages            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] resize_confirm_window          = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] resize_fs_using_block_device   = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] resume_guests_state_on_host_boot = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] rpc_response_timeout           = 60 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] run_external_periodic_tasks    = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] running_deleted_instance_action = reap {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] running_deleted_instance_poll_interval = 1800 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] running_deleted_instance_timeout = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] scheduler_instance_sync_interval = 120 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] service_down_time              = 720 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] servicegroup_driver            = db {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] shelved_offload_time           = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] shelved_poll_interval          = 3600 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] shutdown_timeout               = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] source_is_ipv6                 = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ssl_only                       = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] state_path                     = /opt/stack/data/nova {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] sync_power_state_interval      = 600 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] sync_power_state_pool_size     = 1000 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] syslog_log_facility            = LOG_USER {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] tempdir                        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] timeout_nbd                    = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] transport_url                  = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] update_resources_interval      = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] use_cow_images                 = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] use_eventlog                   = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] use_journal                    = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] use_json                       = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] use_rootwrap_daemon            = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] use_stderr                     = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] use_syslog                     = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vcpu_pin_set                   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plugging_is_fatal          = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plugging_timeout           = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] virt_mkfs                      = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] volume_usage_poll_interval     = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] watch_log_file                 = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] web                            = /usr/share/spice-html5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_concurrency.disable_process_locking = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.auth_strategy              = keystone {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.compute_link_prefix        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.dhcp_domain                = novalocal {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.enable_instance_password   = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.glance_link_prefix         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.instance_list_per_project_cells = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.list_records_by_skipping_down_cells = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.local_metadata_per_cell    = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.max_limit                  = 1000 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.metadata_cache_expiration  = 15 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.neutron_default_tenant_id  = default {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.use_forwarded_for          = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.use_neutron_default_nets   = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.vendordata_dynamic_targets = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.vendordata_jsonfile_path   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.backend                  = dogpile.cache.memcached {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.backend_argument         = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.config_prefix            = cache.oslo {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.dead_timeout             = 60.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.debug_cache_backend      = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.enable_retry_client      = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.enable_socket_keepalive  = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.enabled                  = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.expiration_time          = 600 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.hashclient_retry_attempts = 2 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.memcache_dead_retry      = 300 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.memcache_password        =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.memcache_pool_maxsize    = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.memcache_sasl_enabled    = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.memcache_username        =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.proxies                  = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.retry_attempts           = 2 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.retry_delay              = 0.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.socket_keepalive_count   = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.socket_keepalive_idle    = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.socket_keepalive_interval = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.tls_allowed_ciphers      = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.tls_cafile               = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.tls_certfile             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.tls_enabled              = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cache.tls_keyfile              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.auth_section            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.auth_type               = password {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.cafile                  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.certfile                = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.collect_timing          = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.cross_az_attach         = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.debug                   = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.endpoint_template       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.http_retries            = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.insecure                = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.keyfile                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.os_region_name          = RegionOne {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.split_loggers           = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cinder.timeout                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.cpu_dedicated_set      = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.cpu_shared_set         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.image_type_exclude_list = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.max_concurrent_disk_ops = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.max_disk_devices_to_attach = -1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.resource_provider_association_refresh = 300 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.shutdown_retry_interval = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] conductor.workers              = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] console.allowed_origins        = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] console.ssl_ciphers            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] console.ssl_minimum_version    = default {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] consoleauth.token_ttl          = 600 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.cafile                  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.certfile                = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.collect_timing          = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.connect_retries         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.connect_retry_delay     = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.endpoint_override       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.insecure                = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.keyfile                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.max_version             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.min_version             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.region_name             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.service_name            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.service_type            = accelerator {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.split_loggers           = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.status_code_retries     = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.status_code_retry_delay = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.timeout                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] cyborg.version                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.backend               = sqlalchemy {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.connection            = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.connection_debug      = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.connection_parameters =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.connection_recycle_time = 3600 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.connection_trace      = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.db_inc_retry_interval = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.db_max_retries        = 20 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.db_max_retry_interval = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.db_retry_interval     = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.max_overflow          = 50 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.max_pool_size         = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.max_retries           = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.mysql_wsrep_sync_wait = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.pool_timeout          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.retry_interval        = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.slave_connection      = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] database.sqlite_synchronous    = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.backend           = sqlalchemy {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.connection        = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.connection_debug  = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.connection_parameters =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.connection_recycle_time = 3600 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.connection_trace  = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.db_inc_retry_interval = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.db_max_retries    = 20 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.db_max_retry_interval = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.db_retry_interval = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.max_overflow      = 50 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.max_pool_size     = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.max_retries       = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.pool_timeout      = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.retry_interval    = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.slave_connection  = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] api_database.sqlite_synchronous = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] devices.enabled_mdev_types     = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ephemeral_storage_encryption.enabled = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.api_servers             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.cafile                  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.certfile                = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.collect_timing          = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.connect_retries         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.connect_retry_delay     = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.debug                   = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.default_trusted_certificate_ids = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.enable_certificate_validation = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.enable_rbd_download     = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.endpoint_override       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.insecure                = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.keyfile                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.max_version             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.min_version             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.num_retries             = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.rbd_ceph_conf           =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.rbd_connect_timeout     = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.rbd_pool                =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.rbd_user                =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.region_name             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.service_name            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.service_type            = image {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.split_loggers           = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.status_code_retries     = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.status_code_retry_delay = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.timeout                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.verify_glance_signatures = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] glance.version                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] guestfs.debug                  = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.config_drive_cdrom      = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.config_drive_inject_password = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.enable_instance_metrics_collection = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.enable_remotefx         = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.instances_path_share    =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.iscsi_initiator_list    = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.limit_cpu_features      = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.power_state_check_timeframe = 60 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.use_multipath_io        = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.volume_attach_retry_count = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.vswitch_name            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] mks.enabled                    = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] image_cache.manager_interval   = 2400 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] image_cache.precache_concurrency = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] image_cache.remove_unused_base_images = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] image_cache.subdirectory_name  = _base {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.api_max_retries         = 60 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.api_retry_interval      = 2 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.auth_section            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.auth_type               = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.cafile                  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.certfile                = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.collect_timing          = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.conductor_group         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.connect_retries         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.connect_retry_delay     = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.endpoint_override       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.insecure                = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.keyfile                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.max_version             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.min_version             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.peer_list               = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.region_name             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.serial_console_state_timeout = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.service_name            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.service_type            = baremetal {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.split_loggers           = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.status_code_retries     = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.status_code_retry_delay = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.timeout                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ironic.version                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] key_manager.fixed_key          = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.barbican_api_version  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.barbican_endpoint     = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.barbican_endpoint_type = public {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.barbican_region_name  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.cafile                = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.certfile              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.collect_timing        = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.insecure              = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.keyfile               = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.number_of_retries     = 60 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.retry_delay           = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.send_service_user_token = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.split_loggers         = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.timeout               = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.verify_ssl            = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican.verify_ssl_path       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican_service_user.auth_section = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican_service_user.auth_type = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican_service_user.cafile   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican_service_user.certfile = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican_service_user.collect_timing = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican_service_user.insecure = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican_service_user.keyfile  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican_service_user.split_loggers = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] barbican_service_user.timeout  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.approle_role_id          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.approle_secret_id        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.cafile                   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.certfile                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.collect_timing           = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.insecure                 = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.keyfile                  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.kv_mountpoint            = secret {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.kv_path                  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.kv_version               = 2 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.namespace                = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.root_token_id            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.split_loggers            = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.ssl_ca_crt_file          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.timeout                  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.use_ssl                  = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.auth_section          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.auth_type             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.cafile                = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.certfile              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.collect_timing        = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.connect_retries       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.connect_retry_delay   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.endpoint_override     = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.insecure              = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.keyfile               = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.max_version           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.min_version           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.region_name           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.service_name          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.service_type          = identity {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.split_loggers         = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.status_code_retries   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.status_code_retry_delay = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.timeout               = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] keystone.version               = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.connection_uri         =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.cpu_mode               = custom {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: WARNING oslo_config.cfg [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.cpu_power_governor_high = performance {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.cpu_power_governor_low = powersave {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.cpu_power_management   = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.device_detach_attempts = 8 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.device_detach_timeout  = 20 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.disk_cachemodes        = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.disk_prefix            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.enabled_perf_events    = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.file_backed_memory     = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.gid_maps               = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.hw_disk_discard        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.hw_machine_type        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.images_rbd_glance_store_name =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.images_rbd_pool        = rbd {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.images_type            = default {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.images_volume_group    = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.inject_key             = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.inject_partition       = -2 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.inject_password        = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.iscsi_iface            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.iser_use_multipath     = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_bandwidth = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_downtime = 500 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_inbound_addr = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_permit_post_copy = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_scheme  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_timeout_action = abort {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_tunnelled = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: WARNING oslo_config.cfg [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 12:43:31 user nova-compute[75813]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 12:43:31 user nova-compute[75813]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 12:43:31 user nova-compute[75813]: and ``live_migration_inbound_addr`` respectively.
Nov 15 12:43:31 user nova-compute[75813]: ).  Its value may be silently ignored in the future.
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.live_migration_with_native_tls = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.max_queues             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.nfs_mount_options      = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.num_memory_encrypted_guests = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.num_pcie_ports         = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.pmem_namespaces        = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.quobyte_client_cfg     = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.rbd_secret_uuid        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.rbd_user               = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.remote_filesystem_transport = ssh {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.rescue_image_id        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.rescue_kernel_id       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.rescue_ramdisk_id      = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.rx_queue_size          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.smbfs_mount_options    =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.snapshot_compression   = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.snapshot_image_format  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.sparse_logical_volumes = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.swtpm_enabled          = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.swtpm_group            = tss {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.swtpm_user             = tss {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.sysinfo_serial         = unique {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.tb_cache_size          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.tx_queue_size          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.uid_maps               = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.use_virtio_for_bridges = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.virt_type              = kvm {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.volume_clear           = zero {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.volume_clear_size      = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.volume_use_multipath   = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.vzstorage_cache_path   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.vzstorage_mount_user   = stack {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.auth_section           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.auth_type              = password {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.cafile                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.certfile               = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.collect_timing         = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.connect_retries        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.connect_retry_delay    = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.default_floating_pool  = public {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.endpoint_override      = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.extension_sync_interval = 600 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.http_retries           = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.insecure               = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.keyfile                = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.max_version            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.min_version            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.ovs_bridge             = br-int {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.physnets               = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.region_name            = RegionOne {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.service_metadata_proxy = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.service_name           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.service_type           = network {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.split_loggers          = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.status_code_retries    = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.status_code_retry_delay = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.timeout                = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] neutron.version                = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] notifications.bdms_in_notifications = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] notifications.default_level    = INFO {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] notifications.notification_format = unversioned {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] notifications.notify_on_state_change = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] pci.alias                      = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] pci.device_spec                = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] pci.report_in_placement        = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.auth_section         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.auth_type            = password {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.cafile               = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.certfile             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.collect_timing       = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.connect_retries      = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.connect_retry_delay  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.default_domain_id    = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.default_domain_name  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.domain_id            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.domain_name          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.endpoint_override    = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.insecure             = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.keyfile              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.max_version          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.min_version          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.password             = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.project_domain_id    = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.project_domain_name  = Default {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.project_id           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.project_name         = service {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.region_name          = RegionOne {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.service_name         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.service_type         = placement {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.split_loggers        = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.status_code_retries  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.status_code_retry_delay = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.system_scope         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.timeout              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.trust_id             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.user_domain_id       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.user_domain_name     = Default {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.user_id              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.username             = placement {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] placement.version              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.cores                    = 20 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.count_usage_from_placement = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.injected_file_content_bytes = 10240 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.injected_file_path_length = 255 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.injected_files           = 5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.instances                = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.key_pairs                = 100 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.metadata_items           = 128 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.ram                      = 51200 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.recheck_quota            = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.server_group_members     = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] quota.server_groups            = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] rdp.enabled                    = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] scheduler.image_metadata_prefilter = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] scheduler.max_attempts         = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] scheduler.max_placement_results = 1000 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] scheduler.query_placement_for_image_type_support = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] scheduler.workers              = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.host_subset_size = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.isolated_hosts = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.isolated_images = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.pci_in_placement = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.track_instance_changes = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] metrics.required               = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] metrics.weight_multiplier      = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] metrics.weight_setting         = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] serial_console.enabled         = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] serial_console.port_range      = 10000:20000 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] serial_console.serialproxy_port = 6083 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] service_user.auth_section      = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] service_user.auth_type         = password {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] service_user.cafile            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] service_user.certfile          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] service_user.collect_timing    = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] service_user.insecure          = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] service_user.keyfile           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] service_user.send_service_user_token = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] service_user.split_loggers     = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] service_user.timeout           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.agent_enabled            = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.enabled                  = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.html5proxy_port          = 6082 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.image_compression        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.jpeg_compression         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.playback_compression     = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.server_listen            = 127.0.0.1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.streaming_mode           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] spice.zlib_compression         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] upgrade_levels.baseapi         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] upgrade_levels.cert            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] upgrade_levels.compute         = auto {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] upgrade_levels.conductor       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] upgrade_levels.scheduler       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vendordata_dynamic_auth.auth_section = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vendordata_dynamic_auth.auth_type = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vendordata_dynamic_auth.cafile = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vendordata_dynamic_auth.certfile = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vendordata_dynamic_auth.insecure = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vendordata_dynamic_auth.keyfile = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vendordata_dynamic_auth.timeout = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.api_retry_count         = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.ca_file                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.cache_prefix            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.cluster_name            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.connection_pool_size    = 10 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.console_delay_seconds   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.datastore_regex         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.host_ip                 = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.host_password           = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.host_port               = 443 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.host_username           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.insecure                = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.integration_bridge      = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.maximum_objects         = 100 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.pbm_default_policy      = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.pbm_enabled             = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.pbm_wsdl_location       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.serial_port_proxy_uri   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.serial_port_service_uri = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.task_poll_interval      = 0.5 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.use_linked_clone        = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.vnc_keymap              = en-us {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.vnc_port                = 5900 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vmware.vnc_port_total          = 10000 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vnc.auth_schemes               = ['none'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vnc.enabled                    = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vnc.novncproxy_port            = 6080 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vnc.server_listen              = 0.0.0.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vnc.vencrypt_ca_certs          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vnc.vencrypt_client_cert       = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vnc.vencrypt_client_key        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.disable_rootwrap   = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.enable_numa_live_migration = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.libvirt_disable_apic = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] wsgi.client_socket_timeout     = 900 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] wsgi.default_pool_size         = 1000 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] wsgi.keep_alive                = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] wsgi.max_header_line           = 16384 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] wsgi.ssl_ca_file               = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] wsgi.ssl_cert_file             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] wsgi.ssl_key_file              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] wsgi.tcp_keepidle              = 600 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] zvm.ca_file                    = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] zvm.cloud_connector_url        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] zvm.reachable_timeout          = 300 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_policy.enforce_new_defaults = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_policy.enforce_scope      = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_policy.policy_default_rule = default {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_policy.policy_file        = policy.yaml {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler.connection_string     = messaging:// {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler.enabled               = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler.es_doc_type           = notification {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler.es_scroll_size        = 10000 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler.es_scroll_time        = 2m {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler.filter_error_trace    = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler.hmac_keys             = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler.sentinel_service_name = mymaster {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler.socket_timeout        = 0.1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler.trace_requests        = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler.trace_sqlalchemy      = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler_jaeger.process_tags   = {} {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler_jaeger.service_name_prefix = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] profiler_otlp.service_name_prefix = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] remote_debug.host              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] remote_debug.port              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.ssl      = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_notifications.retry = -1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.auth_section        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.auth_type           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.cafile              = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.certfile            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.collect_timing      = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.connect_retries     = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.connect_retry_delay = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.endpoint_id         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.endpoint_override   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.insecure            = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.keyfile             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.max_version         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.min_version         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.region_name         = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.service_name        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.service_type        = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.split_loggers       = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.status_code_retries = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.status_code_retry_delay = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.timeout             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.valid_interfaces    = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_limit.version             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_reports.file_event_handler = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] oslo_reports.log_dir           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_ovs_privileged.group  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] vif_plug_ovs_privileged.user   = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_linux_bridge.flat_interface = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_ovs.isolate_vif         = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_vif_ovs.per_port_bridge     = False {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] os_brick.lock_path             = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] privsep_osbrick.capabilities   = [21] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] privsep_osbrick.group          = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] privsep_osbrick.helper_command = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] privsep_osbrick.user           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] nova_sys_admin.group           = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] nova_sys_admin.helper_command  = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] nova_sys_admin.user            = None {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG oslo_service.service [None req-51e82e3f-a9f0-4f97-8d51-7346f00d7f5a None None] ******************************************************************************** {{(pid=75813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 12:43:31 user nova-compute[75813]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 12:43:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Connecting to libvirt: qemu:///system {{(pid=75813) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f55518ef190> {{(pid=75813) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 12:43:31 user nova-compute[75813]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 12:43:31 user nova-compute[75813]: WARNING nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 12:43:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f55518ef190> {{(pid=75813) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Starting native event thread {{(pid=75813) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Starting green dispatch thread {{(pid=75813) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 12:43:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Starting connection event dispatch thread {{(pid=75813) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 12:43:31 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Connection event '1' reason 'None'
Nov 15 12:43:31 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 12:43:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.mount [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Initialising _HostMountState generation 0 {{(pid=75813) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 12:43:39 user nova-compute[75813]: INFO nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Libvirt host capabilities <capabilities>
Nov 15 12:43:39 user nova-compute[75813]:   <host>
Nov 15 12:43:39 user nova-compute[75813]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 12:43:39 user nova-compute[75813]:     <cpu>
Nov 15 12:43:39 user nova-compute[75813]:       <arch>x86_64</arch>
Nov 15 12:43:39 user nova-compute[75813]:       <model>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <vendor>Intel</vendor>
Nov 15 12:43:39 user nova-compute[75813]:       <microcode version='1070'/>
Nov 15 12:43:39 user nova-compute[75813]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 12:43:39 user nova-compute[75813]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='ss'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='vmx'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='pcid'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='osxsave'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='hypervisor'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='arat'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='tsc_adjust'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='md-clear'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='arch-capabilities'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='invtsc'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='rsba'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 12:43:39 user nova-compute[75813]:       <pages unit='KiB' size='4'/>
Nov 15 12:43:39 user nova-compute[75813]:       <pages unit='KiB' size='2048'/>
Nov 15 12:43:39 user nova-compute[75813]:     </cpu>
Nov 15 12:43:39 user nova-compute[75813]:     <power_management>
Nov 15 12:43:39 user nova-compute[75813]:       <suspend_mem/>
Nov 15 12:43:39 user nova-compute[75813]:       <suspend_disk/>
Nov 15 12:43:39 user nova-compute[75813]:       <suspend_hybrid/>
Nov 15 12:43:39 user nova-compute[75813]:     </power_management>
Nov 15 12:43:39 user nova-compute[75813]:     <iommu support='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     <migration_features>
Nov 15 12:43:39 user nova-compute[75813]:       <live/>
Nov 15 12:43:39 user nova-compute[75813]:       <uri_transports>
Nov 15 12:43:39 user nova-compute[75813]:         <uri_transport>tcp</uri_transport>
Nov 15 12:43:39 user nova-compute[75813]:         <uri_transport>rdma</uri_transport>
Nov 15 12:43:39 user nova-compute[75813]:       </uri_transports>
Nov 15 12:43:39 user nova-compute[75813]:     </migration_features>
Nov 15 12:43:39 user nova-compute[75813]:     <topology>
Nov 15 12:43:39 user nova-compute[75813]:       <cells num='2'>
Nov 15 12:43:39 user nova-compute[75813]:         <cell id='0'>
Nov 15 12:43:39 user nova-compute[75813]:           <memory unit='KiB'>8140616</memory>
Nov 15 12:43:39 user nova-compute[75813]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 15 12:43:39 user nova-compute[75813]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 12:43:39 user nova-compute[75813]:           <distances>
Nov 15 12:43:39 user nova-compute[75813]:             <sibling id='0' value='10'/>
Nov 15 12:43:39 user nova-compute[75813]:             <sibling id='1' value='20'/>
Nov 15 12:43:39 user nova-compute[75813]:           </distances>
Nov 15 12:43:39 user nova-compute[75813]:           <cpus num='6'>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 12:43:39 user nova-compute[75813]:           </cpus>
Nov 15 12:43:39 user nova-compute[75813]:         </cell>
Nov 15 12:43:39 user nova-compute[75813]:         <cell id='1'>
Nov 15 12:43:39 user nova-compute[75813]:           <memory unit='KiB'>8255100</memory>
Nov 15 12:43:39 user nova-compute[75813]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 15 12:43:39 user nova-compute[75813]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 12:43:39 user nova-compute[75813]:           <distances>
Nov 15 12:43:39 user nova-compute[75813]:             <sibling id='0' value='20'/>
Nov 15 12:43:39 user nova-compute[75813]:             <sibling id='1' value='10'/>
Nov 15 12:43:39 user nova-compute[75813]:           </distances>
Nov 15 12:43:39 user nova-compute[75813]:           <cpus num='6'>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 12:43:39 user nova-compute[75813]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 12:43:39 user nova-compute[75813]:           </cpus>
Nov 15 12:43:39 user nova-compute[75813]:         </cell>
Nov 15 12:43:39 user nova-compute[75813]:       </cells>
Nov 15 12:43:39 user nova-compute[75813]:     </topology>
Nov 15 12:43:39 user nova-compute[75813]:     <cache>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 12:43:39 user nova-compute[75813]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 12:43:39 user nova-compute[75813]:     </cache>
Nov 15 12:43:39 user nova-compute[75813]:     <secmodel>
Nov 15 12:43:39 user nova-compute[75813]:       <model>apparmor</model>
Nov 15 12:43:39 user nova-compute[75813]:       <doi>0</doi>
Nov 15 12:43:39 user nova-compute[75813]:     </secmodel>
Nov 15 12:43:39 user nova-compute[75813]:     <secmodel>
Nov 15 12:43:39 user nova-compute[75813]:       <model>dac</model>
Nov 15 12:43:39 user nova-compute[75813]:       <doi>0</doi>
Nov 15 12:43:39 user nova-compute[75813]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 12:43:39 user nova-compute[75813]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 12:43:39 user nova-compute[75813]:     </secmodel>
Nov 15 12:43:39 user nova-compute[75813]:   </host>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='alpha'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>64</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>clipper</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='armv6l'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>spitz</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>nuri</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>kzm</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sx1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>z2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>tosa</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>n810</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>n800</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>terrier</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>midway</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>microbit</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>verdex</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>highbank</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>akita</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>connex</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>collie</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='armv7l'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>spitz</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>nuri</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>kzm</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sx1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>z2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>tosa</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>n810</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>n800</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>terrier</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>midway</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>microbit</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>verdex</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>highbank</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>akita</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>connex</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>collie</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='aarch64'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>64</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>spitz</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>nuri</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>kzm</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sx1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>z2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>tosa</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>n810</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>n800</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>terrier</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>midway</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>microbit</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>verdex</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>highbank</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>akita</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>connex</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>collie</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <acpi default='on' toggle='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='cris'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='i686'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>isapc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>microvm</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='kvm'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <pae/>
Nov 15 12:43:39 user nova-compute[75813]:       <nonpae/>
Nov 15 12:43:39 user nova-compute[75813]:       <acpi default='on' toggle='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:       <apic default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='m68k'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>an5206</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>q800</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='microblaze'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='microblazeel'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='mips'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='16'>malta</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='mipsel'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='16'>malta</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='mips64'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>64</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='16'>malta</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>pica61</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>magnum</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='mips64el'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>64</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='16'>malta</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>pica61</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>magnum</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='16'>boston</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='ppc'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mac99</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>40p</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>taihu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='ppc64'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>64</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>taihu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>40p</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mac99</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='ppc64le'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>64</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>taihu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>40p</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>mac99</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='riscv32'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='8'>spike</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='8'>virt</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='riscv64'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>64</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='8'>spike</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='8'>virt</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='s390x'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>64</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='sh4'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>shix</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>r2d</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='sh4eb'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>64</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>shix</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>r2d</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='sparc'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>LX</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='sparc64'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>64</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>niagara</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='x86_64'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>64</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='1'>isapc</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>microvm</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='kvm'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <acpi default='on' toggle='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:       <apic default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='xtensa'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>sim</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>kc705</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>ml605</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>virt</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>lx200</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>lx60</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]:   <guest>
Nov 15 12:43:39 user nova-compute[75813]:     <os_type>hvm</os_type>
Nov 15 12:43:39 user nova-compute[75813]:     <arch name='xtensaeb'>
Nov 15 12:43:39 user nova-compute[75813]:       <wordsize>32</wordsize>
Nov 15 12:43:39 user nova-compute[75813]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='4'>sim</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>kc705</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>ml605</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>virt</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>lx200</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>lx60</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 12:43:39 user nova-compute[75813]:       <domain type='qemu'/>
Nov 15 12:43:39 user nova-compute[75813]:     </arch>
Nov 15 12:43:39 user nova-compute[75813]:     <features>
Nov 15 12:43:39 user nova-compute[75813]:       <cpuselection/>
Nov 15 12:43:39 user nova-compute[75813]:       <deviceboot/>
Nov 15 12:43:39 user nova-compute[75813]:       <disksnapshot default='on' toggle='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     </features>
Nov 15 12:43:39 user nova-compute[75813]:   </guest>
Nov 15 12:43:39 user nova-compute[75813]: </capabilities>
Nov 15 12:43:39 user nova-compute[75813]: 
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 12:43:39 user nova-compute[75813]: <domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 12:43:39 user nova-compute[75813]:   <domain>kvm</domain>
Nov 15 12:43:39 user nova-compute[75813]:   <machine>pc-q35-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:   <arch>i686</arch>
Nov 15 12:43:39 user nova-compute[75813]:   <vcpu max='288'/>
Nov 15 12:43:39 user nova-compute[75813]:   <iothreads supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:   <os supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='firmware'/>
Nov 15 12:43:39 user nova-compute[75813]:     <loader supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>rom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pflash</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='readonly'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>yes</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='secure'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </loader>
Nov 15 12:43:39 user nova-compute[75813]:   </os>
Nov 15 12:43:39 user nova-compute[75813]:   <cpu>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-passthrough' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='hostPassthroughMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='maximum' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='maximumMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-model' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <vendor>Intel</vendor>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ss'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='vmx'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pcid'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='hypervisor'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arat'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='umip'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='md-clear'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibpb'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibrs'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='erms'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='lm'/>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='custom' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>qemu64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>qemu32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>phenom</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>n270</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>kvm64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>coreduo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>core2duo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>athlon</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Westmere</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Snowridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Penryn</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G5</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G4</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G1</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Nehalem</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Rome</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Milan</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Dhyana</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cooperlake</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Conroe</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>486</model>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:   </cpu>
Nov 15 12:43:39 user nova-compute[75813]:   <memoryBacking supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='sourceType'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>file</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>anonymous</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>memfd</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:   </memoryBacking>
Nov 15 12:43:39 user nova-compute[75813]:   <devices>
Nov 15 12:43:39 user nova-compute[75813]:     <disk supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='diskDevice'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>disk</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cdrom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>floppy</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>lun</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='bus'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>fdc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sata</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </disk>
Nov 15 12:43:39 user nova-compute[75813]:     <graphics supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sdl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vnc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>spice</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egl-headless</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </graphics>
Nov 15 12:43:39 user nova-compute[75813]:     <video supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='modelType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cirrus</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vmvga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>qxl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>none</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>bochs</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ramfb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </video>
Nov 15 12:43:39 user nova-compute[75813]:     <hostdev supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='mode'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>subsystem</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='startupPolicy'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>default</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>mandatory</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>requisite</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>optional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='subsysType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pci</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='capsType'/>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='pciBackend'/>
Nov 15 12:43:39 user nova-compute[75813]:     </hostdev>
Nov 15 12:43:39 user nova-compute[75813]:     <rng supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>random</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egd</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>builtin</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </rng>
Nov 15 12:43:39 user nova-compute[75813]:     <filesystem supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='driverType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>path</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>handle</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtiofs</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </filesystem>
Nov 15 12:43:39 user nova-compute[75813]:     <tpm supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-tis</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-crb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>passthrough</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>emulator</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </tpm>
Nov 15 12:43:39 user nova-compute[75813]:   </devices>
Nov 15 12:43:39 user nova-compute[75813]:   <features>
Nov 15 12:43:39 user nova-compute[75813]:     <gic supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     <vmcoreinfo supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <genid supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backingStoreInput supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backup supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <sev supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:   </features>
Nov 15 12:43:39 user nova-compute[75813]: </domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:  {{(pid=75813) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 12:43:39 user nova-compute[75813]: <domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 12:43:39 user nova-compute[75813]:   <domain>kvm</domain>
Nov 15 12:43:39 user nova-compute[75813]:   <machine>pc-i440fx-jammy</machine>
Nov 15 12:43:39 user nova-compute[75813]:   <arch>i686</arch>
Nov 15 12:43:39 user nova-compute[75813]:   <vcpu max='255'/>
Nov 15 12:43:39 user nova-compute[75813]:   <iothreads supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:   <os supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='firmware'/>
Nov 15 12:43:39 user nova-compute[75813]:     <loader supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>rom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pflash</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='readonly'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>yes</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='secure'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </loader>
Nov 15 12:43:39 user nova-compute[75813]:   </os>
Nov 15 12:43:39 user nova-compute[75813]:   <cpu>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-passthrough' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='hostPassthroughMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='maximum' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='maximumMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-model' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <vendor>Intel</vendor>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ss'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='vmx'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pcid'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='hypervisor'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arat'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='umip'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='md-clear'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibpb'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibrs'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='erms'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='lm'/>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='custom' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>qemu64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>qemu32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>phenom</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>n270</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>kvm64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>coreduo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>core2duo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>athlon</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Westmere</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Snowridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Penryn</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G5</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G4</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G1</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Nehalem</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Rome</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Milan</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Dhyana</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cooperlake</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Conroe</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>486</model>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:   </cpu>
Nov 15 12:43:39 user nova-compute[75813]:   <memoryBacking supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='sourceType'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>file</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>anonymous</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>memfd</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:   </memoryBacking>
Nov 15 12:43:39 user nova-compute[75813]:   <devices>
Nov 15 12:43:39 user nova-compute[75813]:     <disk supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='diskDevice'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>disk</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cdrom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>floppy</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>lun</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='bus'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ide</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>fdc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sata</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </disk>
Nov 15 12:43:39 user nova-compute[75813]:     <graphics supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sdl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vnc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>spice</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egl-headless</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </graphics>
Nov 15 12:43:39 user nova-compute[75813]:     <video supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='modelType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cirrus</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vmvga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>qxl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>none</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>bochs</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ramfb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </video>
Nov 15 12:43:39 user nova-compute[75813]:     <hostdev supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='mode'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>subsystem</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='startupPolicy'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>default</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>mandatory</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>requisite</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>optional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='subsysType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pci</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='capsType'/>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='pciBackend'/>
Nov 15 12:43:39 user nova-compute[75813]:     </hostdev>
Nov 15 12:43:39 user nova-compute[75813]:     <rng supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>random</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egd</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>builtin</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </rng>
Nov 15 12:43:39 user nova-compute[75813]:     <filesystem supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='driverType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>path</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>handle</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtiofs</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </filesystem>
Nov 15 12:43:39 user nova-compute[75813]:     <tpm supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-tis</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-crb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>passthrough</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>emulator</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </tpm>
Nov 15 12:43:39 user nova-compute[75813]:   </devices>
Nov 15 12:43:39 user nova-compute[75813]:   <features>
Nov 15 12:43:39 user nova-compute[75813]:     <gic supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     <vmcoreinfo supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <genid supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backingStoreInput supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backup supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <sev supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:   </features>
Nov 15 12:43:39 user nova-compute[75813]: </domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:  {{(pid=75813) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 12:43:39 user nova-compute[75813]: <domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 12:43:39 user nova-compute[75813]:   <domain>kvm</domain>
Nov 15 12:43:39 user nova-compute[75813]:   <machine>pc-i440fx-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:   <arch>i686</arch>
Nov 15 12:43:39 user nova-compute[75813]:   <vcpu max='255'/>
Nov 15 12:43:39 user nova-compute[75813]:   <iothreads supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:   <os supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='firmware'/>
Nov 15 12:43:39 user nova-compute[75813]:     <loader supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>rom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pflash</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='readonly'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>yes</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='secure'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </loader>
Nov 15 12:43:39 user nova-compute[75813]:   </os>
Nov 15 12:43:39 user nova-compute[75813]:   <cpu>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-passthrough' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='hostPassthroughMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='maximum' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='maximumMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-model' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <vendor>Intel</vendor>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ss'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='vmx'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pcid'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='hypervisor'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arat'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='umip'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='md-clear'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibpb'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibrs'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='erms'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='lm'/>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='custom' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>qemu64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>qemu32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>phenom</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>n270</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>kvm64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>coreduo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>core2duo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>athlon</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Westmere</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Snowridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Penryn</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G5</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G4</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G1</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Nehalem</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Rome</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Milan</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Dhyana</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cooperlake</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Conroe</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>486</model>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:   </cpu>
Nov 15 12:43:39 user nova-compute[75813]:   <memoryBacking supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='sourceType'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>file</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>anonymous</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>memfd</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:   </memoryBacking>
Nov 15 12:43:39 user nova-compute[75813]:   <devices>
Nov 15 12:43:39 user nova-compute[75813]:     <disk supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='diskDevice'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>disk</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cdrom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>floppy</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>lun</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='bus'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ide</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>fdc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sata</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </disk>
Nov 15 12:43:39 user nova-compute[75813]:     <graphics supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sdl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vnc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>spice</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egl-headless</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </graphics>
Nov 15 12:43:39 user nova-compute[75813]:     <video supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='modelType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cirrus</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vmvga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>qxl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>none</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>bochs</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ramfb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </video>
Nov 15 12:43:39 user nova-compute[75813]:     <hostdev supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='mode'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>subsystem</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='startupPolicy'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>default</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>mandatory</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>requisite</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>optional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='subsysType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pci</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='capsType'/>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='pciBackend'/>
Nov 15 12:43:39 user nova-compute[75813]:     </hostdev>
Nov 15 12:43:39 user nova-compute[75813]:     <rng supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>random</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egd</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>builtin</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </rng>
Nov 15 12:43:39 user nova-compute[75813]:     <filesystem supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='driverType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>path</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>handle</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtiofs</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </filesystem>
Nov 15 12:43:39 user nova-compute[75813]:     <tpm supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-tis</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-crb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>passthrough</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>emulator</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </tpm>
Nov 15 12:43:39 user nova-compute[75813]:   </devices>
Nov 15 12:43:39 user nova-compute[75813]:   <features>
Nov 15 12:43:39 user nova-compute[75813]:     <gic supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     <vmcoreinfo supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <genid supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backingStoreInput supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backup supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <sev supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:   </features>
Nov 15 12:43:39 user nova-compute[75813]: </domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:  {{(pid=75813) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 12:43:39 user nova-compute[75813]: <domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 12:43:39 user nova-compute[75813]:   <domain>kvm</domain>
Nov 15 12:43:39 user nova-compute[75813]:   <machine>pc-q35-jammy</machine>
Nov 15 12:43:39 user nova-compute[75813]:   <arch>i686</arch>
Nov 15 12:43:39 user nova-compute[75813]:   <vcpu max='288'/>
Nov 15 12:43:39 user nova-compute[75813]:   <iothreads supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:   <os supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='firmware'/>
Nov 15 12:43:39 user nova-compute[75813]:     <loader supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>rom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pflash</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='readonly'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>yes</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='secure'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </loader>
Nov 15 12:43:39 user nova-compute[75813]:   </os>
Nov 15 12:43:39 user nova-compute[75813]:   <cpu>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-passthrough' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='hostPassthroughMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='maximum' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='maximumMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-model' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <vendor>Intel</vendor>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ss'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='vmx'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pcid'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='hypervisor'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arat'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='umip'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='md-clear'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibpb'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibrs'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='erms'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='lm'/>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='custom' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>qemu64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>qemu32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>phenom</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>n270</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>kvm64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>coreduo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>core2duo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>athlon</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Westmere</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Snowridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Penryn</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G5</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G4</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G1</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Nehalem</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Rome</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Milan</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Dhyana</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cooperlake</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Conroe</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>486</model>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:   </cpu>
Nov 15 12:43:39 user nova-compute[75813]:   <memoryBacking supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='sourceType'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>file</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>anonymous</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>memfd</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:   </memoryBacking>
Nov 15 12:43:39 user nova-compute[75813]:   <devices>
Nov 15 12:43:39 user nova-compute[75813]:     <disk supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='diskDevice'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>disk</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cdrom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>floppy</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>lun</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='bus'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>fdc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sata</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </disk>
Nov 15 12:43:39 user nova-compute[75813]:     <graphics supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sdl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vnc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>spice</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egl-headless</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </graphics>
Nov 15 12:43:39 user nova-compute[75813]:     <video supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='modelType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cirrus</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vmvga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>qxl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>none</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>bochs</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ramfb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </video>
Nov 15 12:43:39 user nova-compute[75813]:     <hostdev supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='mode'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>subsystem</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='startupPolicy'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>default</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>mandatory</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>requisite</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>optional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='subsysType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pci</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='capsType'/>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='pciBackend'/>
Nov 15 12:43:39 user nova-compute[75813]:     </hostdev>
Nov 15 12:43:39 user nova-compute[75813]:     <rng supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>random</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egd</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>builtin</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </rng>
Nov 15 12:43:39 user nova-compute[75813]:     <filesystem supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='driverType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>path</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>handle</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtiofs</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </filesystem>
Nov 15 12:43:39 user nova-compute[75813]:     <tpm supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-tis</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-crb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>passthrough</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>emulator</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </tpm>
Nov 15 12:43:39 user nova-compute[75813]:   </devices>
Nov 15 12:43:39 user nova-compute[75813]:   <features>
Nov 15 12:43:39 user nova-compute[75813]:     <gic supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     <vmcoreinfo supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <genid supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backingStoreInput supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backup supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <sev supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:   </features>
Nov 15 12:43:39 user nova-compute[75813]: </domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:  {{(pid=75813) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 12:43:39 user nova-compute[75813]: <domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 12:43:39 user nova-compute[75813]:   <domain>kvm</domain>
Nov 15 12:43:39 user nova-compute[75813]:   <machine>pc-q35-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:   <arch>x86_64</arch>
Nov 15 12:43:39 user nova-compute[75813]:   <vcpu max='288'/>
Nov 15 12:43:39 user nova-compute[75813]:   <iothreads supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:   <os supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='firmware'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>efi</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:     <loader supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>rom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pflash</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='readonly'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>yes</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='secure'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>yes</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </loader>
Nov 15 12:43:39 user nova-compute[75813]:   </os>
Nov 15 12:43:39 user nova-compute[75813]:   <cpu>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-passthrough' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='hostPassthroughMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='maximum' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='maximumMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-model' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <vendor>Intel</vendor>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ss'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='vmx'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pcid'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='hypervisor'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arat'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='umip'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='md-clear'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='invtsc'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibpb'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibrs'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='rsba'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='erms'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='custom' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>qemu64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>qemu32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>phenom</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>n270</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>coreduo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>core2duo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>athlon</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Westmere</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Snowridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Penryn</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G5</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G4</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Opteron_G1</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Nehalem</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Rome</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Milan</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Dhyana</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cooperlake</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Conroe</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>486</model>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:   </cpu>
Nov 15 12:43:39 user nova-compute[75813]:   <memoryBacking supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='sourceType'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>file</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>anonymous</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>memfd</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:   </memoryBacking>
Nov 15 12:43:39 user nova-compute[75813]:   <devices>
Nov 15 12:43:39 user nova-compute[75813]:     <disk supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='diskDevice'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>disk</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cdrom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>floppy</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>lun</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='bus'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>fdc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sata</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </disk>
Nov 15 12:43:39 user nova-compute[75813]:     <graphics supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sdl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vnc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>spice</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egl-headless</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </graphics>
Nov 15 12:43:39 user nova-compute[75813]:     <video supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='modelType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cirrus</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vmvga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>qxl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>none</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>bochs</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ramfb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </video>
Nov 15 12:43:39 user nova-compute[75813]:     <hostdev supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='mode'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>subsystem</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='startupPolicy'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>default</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>mandatory</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>requisite</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>optional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='subsysType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pci</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='capsType'/>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='pciBackend'/>
Nov 15 12:43:39 user nova-compute[75813]:     </hostdev>
Nov 15 12:43:39 user nova-compute[75813]:     <rng supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>random</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egd</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>builtin</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </rng>
Nov 15 12:43:39 user nova-compute[75813]:     <filesystem supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='driverType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>path</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>handle</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtiofs</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </filesystem>
Nov 15 12:43:39 user nova-compute[75813]:     <tpm supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-tis</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-crb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>passthrough</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>emulator</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </tpm>
Nov 15 12:43:39 user nova-compute[75813]:   </devices>
Nov 15 12:43:39 user nova-compute[75813]:   <features>
Nov 15 12:43:39 user nova-compute[75813]:     <gic supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     <vmcoreinfo supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <genid supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backingStoreInput supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backup supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <sev supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:   </features>
Nov 15 12:43:39 user nova-compute[75813]: </domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:  {{(pid=75813) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 12:43:39 user nova-compute[75813]: <domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 12:43:39 user nova-compute[75813]:   <domain>kvm</domain>
Nov 15 12:43:39 user nova-compute[75813]:   <machine>pc-i440fx-jammy</machine>
Nov 15 12:43:39 user nova-compute[75813]:   <arch>x86_64</arch>
Nov 15 12:43:39 user nova-compute[75813]:   <vcpu max='255'/>
Nov 15 12:43:39 user nova-compute[75813]:   <iothreads supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:   <os supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='firmware'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>efi</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:     <loader supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>rom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pflash</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='readonly'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>yes</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='secure'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </loader>
Nov 15 12:43:39 user nova-compute[75813]:   </os>
Nov 15 12:43:39 user nova-compute[75813]:   <cpu>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-passthrough' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='hostPassthroughMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='maximum' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='maximumMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-model' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <vendor>Intel</vendor>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ss'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='vmx'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pcid'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='hypervisor'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arat'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='umip'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='md-clear'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='invtsc'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibpb'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibrs'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='rsba'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='erms'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='custom' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>qemu64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>qemu32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>phenom</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>n270</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>coreduo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>core2duo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>athlon</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Westmere</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Snowridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Penryn</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G5</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G4</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Opteron_G1</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Nehalem</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Rome</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Milan</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Dhyana</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cooperlake</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Conroe</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>486</model>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:   </cpu>
Nov 15 12:43:39 user nova-compute[75813]:   <memoryBacking supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='sourceType'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>file</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>anonymous</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>memfd</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:   </memoryBacking>
Nov 15 12:43:39 user nova-compute[75813]:   <devices>
Nov 15 12:43:39 user nova-compute[75813]:     <disk supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='diskDevice'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>disk</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cdrom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>floppy</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>lun</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='bus'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ide</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>fdc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sata</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </disk>
Nov 15 12:43:39 user nova-compute[75813]:     <graphics supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sdl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vnc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>spice</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egl-headless</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </graphics>
Nov 15 12:43:39 user nova-compute[75813]:     <video supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='modelType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cirrus</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vmvga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>qxl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>none</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>bochs</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ramfb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </video>
Nov 15 12:43:39 user nova-compute[75813]:     <hostdev supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='mode'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>subsystem</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='startupPolicy'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>default</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>mandatory</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>requisite</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>optional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='subsysType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pci</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='capsType'/>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='pciBackend'/>
Nov 15 12:43:39 user nova-compute[75813]:     </hostdev>
Nov 15 12:43:39 user nova-compute[75813]:     <rng supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>random</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egd</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>builtin</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </rng>
Nov 15 12:43:39 user nova-compute[75813]:     <filesystem supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='driverType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>path</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>handle</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtiofs</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </filesystem>
Nov 15 12:43:39 user nova-compute[75813]:     <tpm supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-tis</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-crb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>passthrough</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>emulator</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </tpm>
Nov 15 12:43:39 user nova-compute[75813]:   </devices>
Nov 15 12:43:39 user nova-compute[75813]:   <features>
Nov 15 12:43:39 user nova-compute[75813]:     <gic supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     <vmcoreinfo supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <genid supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backingStoreInput supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backup supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <sev supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:   </features>
Nov 15 12:43:39 user nova-compute[75813]: </domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:  {{(pid=75813) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 12:43:39 user nova-compute[75813]: <domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 12:43:39 user nova-compute[75813]:   <domain>kvm</domain>
Nov 15 12:43:39 user nova-compute[75813]:   <machine>pc-i440fx-6.2</machine>
Nov 15 12:43:39 user nova-compute[75813]:   <arch>x86_64</arch>
Nov 15 12:43:39 user nova-compute[75813]:   <vcpu max='255'/>
Nov 15 12:43:39 user nova-compute[75813]:   <iothreads supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:   <os supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='firmware'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>efi</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:     <loader supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>rom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pflash</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='readonly'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>yes</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='secure'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </loader>
Nov 15 12:43:39 user nova-compute[75813]:   </os>
Nov 15 12:43:39 user nova-compute[75813]:   <cpu>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-passthrough' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='hostPassthroughMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='maximum' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='maximumMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-model' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <vendor>Intel</vendor>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ss'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='vmx'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pcid'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='hypervisor'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arat'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='umip'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='md-clear'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='invtsc'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibpb'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibrs'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='rsba'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='erms'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='custom' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>qemu64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>qemu32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>phenom</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>n270</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>coreduo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>core2duo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>athlon</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Westmere</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Snowridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Penryn</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G5</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G4</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Opteron_G1</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Nehalem</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Rome</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Milan</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Dhyana</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cooperlake</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Conroe</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>486</model>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:   </cpu>
Nov 15 12:43:39 user nova-compute[75813]:   <memoryBacking supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='sourceType'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>file</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>anonymous</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>memfd</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:   </memoryBacking>
Nov 15 12:43:39 user nova-compute[75813]:   <devices>
Nov 15 12:43:39 user nova-compute[75813]:     <disk supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='diskDevice'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>disk</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cdrom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>floppy</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>lun</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='bus'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ide</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>fdc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sata</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </disk>
Nov 15 12:43:39 user nova-compute[75813]:     <graphics supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sdl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vnc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>spice</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egl-headless</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </graphics>
Nov 15 12:43:39 user nova-compute[75813]:     <video supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='modelType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cirrus</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vmvga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>qxl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>none</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>bochs</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ramfb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </video>
Nov 15 12:43:39 user nova-compute[75813]:     <hostdev supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='mode'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>subsystem</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='startupPolicy'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>default</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>mandatory</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>requisite</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>optional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='subsysType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pci</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='capsType'/>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='pciBackend'/>
Nov 15 12:43:39 user nova-compute[75813]:     </hostdev>
Nov 15 12:43:39 user nova-compute[75813]:     <rng supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>random</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egd</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>builtin</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </rng>
Nov 15 12:43:39 user nova-compute[75813]:     <filesystem supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='driverType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>path</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>handle</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtiofs</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </filesystem>
Nov 15 12:43:39 user nova-compute[75813]:     <tpm supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-tis</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-crb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>passthrough</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>emulator</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </tpm>
Nov 15 12:43:39 user nova-compute[75813]:   </devices>
Nov 15 12:43:39 user nova-compute[75813]:   <features>
Nov 15 12:43:39 user nova-compute[75813]:     <gic supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     <vmcoreinfo supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <genid supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backingStoreInput supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backup supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <sev supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:   </features>
Nov 15 12:43:39 user nova-compute[75813]: </domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:  {{(pid=75813) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 12:43:39 user nova-compute[75813]: <domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 12:43:39 user nova-compute[75813]:   <domain>kvm</domain>
Nov 15 12:43:39 user nova-compute[75813]:   <machine>pc-q35-jammy</machine>
Nov 15 12:43:39 user nova-compute[75813]:   <arch>x86_64</arch>
Nov 15 12:43:39 user nova-compute[75813]:   <vcpu max='288'/>
Nov 15 12:43:39 user nova-compute[75813]:   <iothreads supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:   <os supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='firmware'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>efi</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:     <loader supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>rom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pflash</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='readonly'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>yes</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='secure'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>yes</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>no</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </loader>
Nov 15 12:43:39 user nova-compute[75813]:   </os>
Nov 15 12:43:39 user nova-compute[75813]:   <cpu>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-passthrough' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='hostPassthroughMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='maximum' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='maximumMigratable'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>on</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>off</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='host-model' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <vendor>Intel</vendor>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ss'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='vmx'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pcid'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='hypervisor'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arat'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='umip'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='md-clear'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='invtsc'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibpb'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='ibrs'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-stibp'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='rsba'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='erms'/>
Nov 15 12:43:39 user nova-compute[75813]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:     <mode name='custom' supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>qemu64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>qemu32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>phenom</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>pentium</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>n270</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm64</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>kvm32</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>coreduo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>core2duo</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>athlon</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Westmere</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Snowridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Skylake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>SandyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Penryn</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G5</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G4</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G3</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Opteron_G2</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Opteron_G1</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Nehalem</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>IvyBridge</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Icelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Haswell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Rome</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-Milan</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>EPYC</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Dhyana</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cooperlake</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>Conroe</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='no'>Broadwell</model>
Nov 15 12:43:39 user nova-compute[75813]:       <model usable='yes'>486</model>
Nov 15 12:43:39 user nova-compute[75813]:     </mode>
Nov 15 12:43:39 user nova-compute[75813]:   </cpu>
Nov 15 12:43:39 user nova-compute[75813]:   <memoryBacking supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:     <enum name='sourceType'>
Nov 15 12:43:39 user nova-compute[75813]:       <value>file</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>anonymous</value>
Nov 15 12:43:39 user nova-compute[75813]:       <value>memfd</value>
Nov 15 12:43:39 user nova-compute[75813]:     </enum>
Nov 15 12:43:39 user nova-compute[75813]:   </memoryBacking>
Nov 15 12:43:39 user nova-compute[75813]:   <devices>
Nov 15 12:43:39 user nova-compute[75813]:     <disk supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='diskDevice'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>disk</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cdrom</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>floppy</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>lun</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='bus'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>fdc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sata</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </disk>
Nov 15 12:43:39 user nova-compute[75813]:     <graphics supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='type'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>sdl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vnc</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>spice</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egl-headless</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </graphics>
Nov 15 12:43:39 user nova-compute[75813]:     <video supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='modelType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>cirrus</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>vmvga</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>qxl</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>none</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>bochs</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>ramfb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </video>
Nov 15 12:43:39 user nova-compute[75813]:     <hostdev supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='mode'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>subsystem</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='startupPolicy'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>default</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>mandatory</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>requisite</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>optional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='subsysType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>usb</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>pci</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>scsi</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='capsType'/>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='pciBackend'/>
Nov 15 12:43:39 user nova-compute[75813]:     </hostdev>
Nov 15 12:43:39 user nova-compute[75813]:     <rng supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtio-non-transitional</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>random</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>egd</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>builtin</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </rng>
Nov 15 12:43:39 user nova-compute[75813]:     <filesystem supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='driverType'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>path</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>handle</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>virtiofs</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </filesystem>
Nov 15 12:43:39 user nova-compute[75813]:     <tpm supported='yes'>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='model'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-tis</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>tpm-crb</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:       <enum name='backendModel'>
Nov 15 12:43:39 user nova-compute[75813]:         <value>passthrough</value>
Nov 15 12:43:39 user nova-compute[75813]:         <value>emulator</value>
Nov 15 12:43:39 user nova-compute[75813]:       </enum>
Nov 15 12:43:39 user nova-compute[75813]:     </tpm>
Nov 15 12:43:39 user nova-compute[75813]:   </devices>
Nov 15 12:43:39 user nova-compute[75813]:   <features>
Nov 15 12:43:39 user nova-compute[75813]:     <gic supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:     <vmcoreinfo supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <genid supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backingStoreInput supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <backup supported='yes'/>
Nov 15 12:43:39 user nova-compute[75813]:     <sev supported='no'/>
Nov 15 12:43:39 user nova-compute[75813]:   </features>
Nov 15 12:43:39 user nova-compute[75813]: </domainCapabilities>
Nov 15 12:43:39 user nova-compute[75813]:  {{(pid=75813) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75813) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75813) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Checking secure boot support for host arch (x86_64) {{(pid=75813) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 12:43:39 user nova-compute[75813]: INFO nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Secure Boot support detected
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] cpu compare xml: <cpu match="exact">
Nov 15 12:43:39 user nova-compute[75813]:   <model>Nehalem</model>
Nov 15 12:43:39 user nova-compute[75813]: </cpu>
Nov 15 12:43:39 user nova-compute[75813]:  {{(pid=75813) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 12:43:39 user nova-compute[75813]: INFO nova.virt.node [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Generated node identity 55ef6276-ce17-4a96-a641-e38882572693
Nov 15 12:43:39 user nova-compute[75813]: INFO nova.virt.node [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Wrote node identity 55ef6276-ce17-4a96-a641-e38882572693 to /opt/stack/data/nova/compute_id
Nov 15 12:43:39 user nova-compute[75813]: WARNING nova.compute.manager [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Compute nodes ['55ef6276-ce17-4a96-a641-e38882572693'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 12:43:39 user nova-compute[75813]: INFO nova.compute.manager [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 12:43:39 user nova-compute[75813]: WARNING nova.compute.manager [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 12:43:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:43:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:43:40 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:43:40 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Hypervisor/Node resource view: name=user free_ram=10931MB free_disk=26.03829574584961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:43:40 user nova-compute[75813]: WARNING nova.compute.resource_tracker [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] No compute node record for user:55ef6276-ce17-4a96-a641-e38882572693: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 55ef6276-ce17-4a96-a641-e38882572693 could not be found.
Nov 15 12:43:40 user nova-compute[75813]: INFO nova.compute.resource_tracker [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Compute node record created for user:user with uuid: 55ef6276-ce17-4a96-a641-e38882572693
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:43:40 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] [req-4b52a417-09ae-45de-8f1a-3d188ff07ddd] Created resource provider record via placement API for resource provider with UUID 55ef6276-ce17-4a96-a641-e38882572693 and name user.
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75813) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 12:43:40 user nova-compute[75813]: INFO nova.virt.libvirt.host [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] kernel doesn't support AMD SEV
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Libvirt baseline CPU <cpu>
Nov 15 12:43:40 user nova-compute[75813]:   <arch>x86_64</arch>
Nov 15 12:43:40 user nova-compute[75813]:   <model>Nehalem</model>
Nov 15 12:43:40 user nova-compute[75813]:   <vendor>Intel</vendor>
Nov 15 12:43:40 user nova-compute[75813]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 12:43:40 user nova-compute[75813]: </cpu>
Nov 15 12:43:40 user nova-compute[75813]:  {{(pid=75813) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Updated inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Updating resource provider 55ef6276-ce17-4a96-a641-e38882572693 generation from 0 to 1 during operation: update_inventory {{(pid=75813) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Updating resource provider 55ef6276-ce17-4a96-a641-e38882572693 generation from 1 to 2 during operation: update_traits {{(pid=75813) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.service [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Creating RPC server for service compute {{(pid=75813) start /opt/stack/nova/nova/service.py:182}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.service [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] Join ServiceGroup membership for this service compute {{(pid=75813) start /opt/stack/nova/nova/service.py:199}}
Nov 15 12:43:40 user nova-compute[75813]: DEBUG nova.servicegroup.drivers.db [None req-8c4c5334-617b-4f7c-9b9e-51aa7724049c None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75813) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 12:43:50 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:43:50 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:44:31 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:44:31 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:44:31 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=10382MB free_disk=25.942161560058594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:44:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:45:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:45:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:45:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:45:32 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:45:32 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:45:32 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=10280MB free_disk=26.006507873535156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:45:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.102s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:45:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:45:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:45:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:45:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:45:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 12:45:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:45:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:46:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:46:33 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:46:33 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:46:33 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=10307MB free_disk=25.758888244628906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:46:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:46:34 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:46:34 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:46:34 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:46:34 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:46:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:47:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:47:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "870cf760-ae0c-4df1-99cf-6403d8e642ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:47:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:47:33 user nova-compute[75813]: INFO nova.compute.claims [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Claim successful on node user
Nov 15 12:47:34 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:47:34 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:47:34 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:47:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:47:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:47:34 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:47:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:47:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:47:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:47:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:47:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Creating image(s)
Nov 15 12:47:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "/opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "/opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "/opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Skipping network cache update for instance because it is Building. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:47:35 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:47:35 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:47:35 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9503MB free_disk=25.777572631835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4.part --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG nova.policy [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46c14d0607324e6ba1e447b5f5945a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb93fcbc60e4efbb8d3bb0c657f1b64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 870cf760-ae0c-4df1-99cf-6403d8e642ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4.part --force-share --output=json" returned: 0 in 0.209s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG nova.virt.images [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] 4d13142f-f571-4806-9713-890c0afeb458 was qcow2, converting to raw {{(pid=75813) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4.part /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4.converted {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.800s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4.part /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4.converted" returned: 0 in 0.301s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4.converted --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.813s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:36 user nova-compute[75813]: INFO oslo.privsep.daemon [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpiv5smm7c/privsep.sock']
Nov 15 12:47:36 user sudo[85073]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpiv5smm7c/privsep.sock
Nov 15 12:47:36 user sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 12:47:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:47:37 user nova-compute[75813]: INFO nova.compute.claims [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Claim successful on node user
Nov 15 12:47:37 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Successfully created port: 460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:47:37 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:47:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:47:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:47:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Creating image(s)
Nov 15 12:47:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "/opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "/opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG nova.policy [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be1459c348da4131bb1c97ceba21bdd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920f3cb902f491b848d660c757eab49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:47:38 user sudo[85073]: pam_unix(sudo:session): session closed for user root
Nov 15 12:47:38 user nova-compute[75813]: INFO oslo.privsep.daemon [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Spawned new privsep daemon via rootwrap
Nov 15 12:47:38 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 12:47:38 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 12:47:38 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 12:47:38 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85134
Nov 15 12:47:38 user nova-compute[75813]: WARNING oslo_privsep.priv_context [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] privsep daemon already running
Nov 15 12:47:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.213s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk 1073741824" returned: 0 in 0.054s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.266s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.192s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk 1073741824" returned: 0 in 0.067s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Cannot resize image /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Ensure instance console log exists: /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.197s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Cannot resize image /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Ensure instance console log exists: /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Successfully created port: 1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:47:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Successfully updated port: 460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:47:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:47:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquired lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:47:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:47:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:47:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-bf920193-a8e1-4627-a78f-0fac166ae687 req-1570f723-a4b7-43ee-9315-9127a8e78f71 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Received event network-changed-460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:47:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-bf920193-a8e1-4627-a78f-0fac166ae687 req-1570f723-a4b7-43ee-9315-9127a8e78f71 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Refreshing instance network info cache due to event network-changed-460a944c-a9e9-43e9-9a0a-c071cbf471e4. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:47:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bf920193-a8e1-4627-a78f-0fac166ae687 req-1570f723-a4b7-43ee-9315-9127a8e78f71 service nova] Acquiring lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Updating instance_info_cache with network_info: [{"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Releasing lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Instance network_info: |[{"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bf920193-a8e1-4627-a78f-0fac166ae687 req-1570f723-a4b7-43ee-9315-9127a8e78f71 service nova] Acquired lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.network.neutron [req-bf920193-a8e1-4627-a78f-0fac166ae687 req-1570f723-a4b7-43ee-9315-9127a8e78f71 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Refreshing network info cache for port 460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Start _get_guest_xml network_info=[{"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:47:41 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:47:41 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-986294058',display_name='tempest-ServersNegativeTestJSON-server-986294058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-986294058',id=1,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abb93fcbc60e4efbb8d3bb0c657f1b64',ramdisk_id='',reservation_id='r-6vtu6bez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-880603076',owner_user_name='tempest-ServersNegativeTestJSON-880603076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:47:35Z,user_data=None,user_id='46c14d0607324e6ba1e447b5f5945a99',uuid=870cf760-ae0c-4df1-99cf-6403d8e642ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converting VIF {"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:8c:02,bridge_name='br-int',has_traffic_filtering=True,id=460a944c-a9e9-43e9-9a0a-c071cbf471e4,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460a944c-a9') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.objects.instance [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lazy-loading 'pci_devices' on Instance uuid 870cf760-ae0c-4df1-99cf-6403d8e642ce {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:47:41 user nova-compute[75813]:   <uuid>870cf760-ae0c-4df1-99cf-6403d8e642ce</uuid>
Nov 15 12:47:41 user nova-compute[75813]:   <name>instance-00000001</name>
Nov 15 12:47:41 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:47:41 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:47:41 user nova-compute[75813]:   <metadata>
Nov 15 12:47:41 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:47:41 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:47:41 user nova-compute[75813]:       <nova:name>tempest-ServersNegativeTestJSON-server-986294058</nova:name>
Nov 15 12:47:41 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:47:41</nova:creationTime>
Nov 15 12:47:41 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:47:41 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:47:41 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:47:41 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:47:41 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:47:41 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:47:41 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:47:41 user nova-compute[75813]:       <nova:owner>
Nov 15 12:47:41 user nova-compute[75813]:         <nova:user uuid="46c14d0607324e6ba1e447b5f5945a99">tempest-ServersNegativeTestJSON-880603076-project-member</nova:user>
Nov 15 12:47:41 user nova-compute[75813]:         <nova:project uuid="abb93fcbc60e4efbb8d3bb0c657f1b64">tempest-ServersNegativeTestJSON-880603076</nova:project>
Nov 15 12:47:41 user nova-compute[75813]:       </nova:owner>
Nov 15 12:47:41 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:47:41 user nova-compute[75813]:       <nova:ports>
Nov 15 12:47:41 user nova-compute[75813]:         <nova:port uuid="460a944c-a9e9-43e9-9a0a-c071cbf471e4">
Nov 15 12:47:41 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 12:47:41 user nova-compute[75813]:         </nova:port>
Nov 15 12:47:41 user nova-compute[75813]:       </nova:ports>
Nov 15 12:47:41 user nova-compute[75813]:     </nova:instance>
Nov 15 12:47:41 user nova-compute[75813]:   </metadata>
Nov 15 12:47:41 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:47:41 user nova-compute[75813]:     <system>
Nov 15 12:47:41 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:47:41 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:47:41 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:47:41 user nova-compute[75813]:       <entry name="serial">870cf760-ae0c-4df1-99cf-6403d8e642ce</entry>
Nov 15 12:47:41 user nova-compute[75813]:       <entry name="uuid">870cf760-ae0c-4df1-99cf-6403d8e642ce</entry>
Nov 15 12:47:41 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:47:41 user nova-compute[75813]:     </system>
Nov 15 12:47:41 user nova-compute[75813]:   </sysinfo>
Nov 15 12:47:41 user nova-compute[75813]:   <os>
Nov 15 12:47:41 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:47:41 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:47:41 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:47:41 user nova-compute[75813]:   </os>
Nov 15 12:47:41 user nova-compute[75813]:   <features>
Nov 15 12:47:41 user nova-compute[75813]:     <acpi/>
Nov 15 12:47:41 user nova-compute[75813]:     <apic/>
Nov 15 12:47:41 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:47:41 user nova-compute[75813]:   </features>
Nov 15 12:47:41 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:47:41 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:47:41 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:47:41 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:47:41 user nova-compute[75813]:   </clock>
Nov 15 12:47:41 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:47:41 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:47:41 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:47:41 user nova-compute[75813]:   </cpu>
Nov 15 12:47:41 user nova-compute[75813]:   <devices>
Nov 15 12:47:41 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:47:41 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:47:41 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk"/>
Nov 15 12:47:41 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:47:41 user nova-compute[75813]:     </disk>
Nov 15 12:47:41 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:47:41 user nova-compute[75813]:       <mac address="fa:16:3e:23:8c:02"/>
Nov 15 12:47:41 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:47:41 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:47:41 user nova-compute[75813]:       <target dev="tap460a944c-a9"/>
Nov 15 12:47:41 user nova-compute[75813]:     </interface>
Nov 15 12:47:41 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:47:41 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/console.log" append="off"/>
Nov 15 12:47:41 user nova-compute[75813]:     </serial>
Nov 15 12:47:41 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:47:41 user nova-compute[75813]:     <video>
Nov 15 12:47:41 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:47:41 user nova-compute[75813]:     </video>
Nov 15 12:47:41 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:47:41 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:47:41 user nova-compute[75813]:     </rng>
Nov 15 12:47:41 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:47:41 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:47:41 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:47:41 user nova-compute[75813]:     </memballoon>
Nov 15 12:47:41 user nova-compute[75813]:   </devices>
Nov 15 12:47:41 user nova-compute[75813]: </domain>
Nov 15 12:47:41 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-986294058',display_name='tempest-ServersNegativeTestJSON-server-986294058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-986294058',id=1,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abb93fcbc60e4efbb8d3bb0c657f1b64',ramdisk_id='',reservation_id='r-6vtu6bez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-880603076',owner_user_name='tempest-ServersNegativeTestJSON-880603076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:47:35Z,user_data=None,user_id='46c14d0607324e6ba1e447b5f5945a99',uuid=870cf760-ae0c-4df1-99cf-6403d8e642ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converting VIF {"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:8c:02,bridge_name='br-int',has_traffic_filtering=True,id=460a944c-a9e9-43e9-9a0a-c071cbf471e4,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460a944c-a9') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG os_vif [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:8c:02,bridge_name='br-int',has_traffic_filtering=True,id=460a944c-a9e9-43e9-9a0a-c071cbf471e4,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460a944c-a9') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Created schema index Interface.name {{(pid=75813) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Created schema index Port.name {{(pid=75813) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Created schema index Bridge.name {{(pid=75813) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [POLLOUT] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a32acfc-ecfc-54c7-b60c-fdc4dd1e4515', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:47:41 user nova-compute[75813]: INFO oslo.privsep.daemon [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpbjltpd1c/privsep.sock']
Nov 15 12:47:41 user sudo[85178]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpbjltpd1c/privsep.sock
Nov 15 12:47:41 user sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:47:42 user nova-compute[75813]: INFO nova.compute.claims [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Claim successful on node user
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Successfully updated port: 1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.network.neutron [req-bf920193-a8e1-4627-a78f-0fac166ae687 req-1570f723-a4b7-43ee-9315-9127a8e78f71 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Updated VIF entry in instance network info cache for port 460a944c-a9e9-43e9-9a0a-c071cbf471e4. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.network.neutron [req-bf920193-a8e1-4627-a78f-0fac166ae687 req-1570f723-a4b7-43ee-9315-9127a8e78f71 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Updating instance_info_cache with network_info: [{"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "refresh_cache-7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquired lock "refresh_cache-7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bf920193-a8e1-4627-a78f-0fac166ae687 req-1570f723-a4b7-43ee-9315-9127a8e78f71 service nova] Releasing lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:47:42 user nova-compute[75813]: INFO nova.compute.claims [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Claim successful on node user
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:47:42 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:47:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.policy [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66e8cb4b92ee40b9875ac675ec63b982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb2a7b27b904d639b7df886781d587f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-1734a69f-7d6f-4056-8ecf-86b41058383d req-6244c45b-37de-47e5-a37b-84cda4fe8993 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Received event network-changed-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-1734a69f-7d6f-4056-8ecf-86b41058383d req-6244c45b-37de-47e5-a37b-84cda4fe8993 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Refreshing instance network info cache due to event network-changed-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1734a69f-7d6f-4056-8ecf-86b41058383d req-6244c45b-37de-47e5-a37b-84cda4fe8993 service nova] Acquiring lock "refresh_cache-7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:47:43 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Creating image(s)
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "/opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "/opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "/opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:43 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:47:43 user sudo[85178]: pam_unix(sudo:session): session closed for user root
Nov 15 12:47:43 user nova-compute[75813]: INFO oslo.privsep.daemon [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Spawned new privsep daemon via rootwrap
Nov 15 12:47:43 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 12:47:43 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 12:47:43 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 12:47:43 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85188
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.238s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:47:43 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Creating image(s)
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "/opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "/opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "/opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Updating instance_info_cache with network_info: [{"id": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "address": "fa:16:3e:69:f1:a6", "network": {"id": "dfc5cc02-1e20-49c8-b735-f79be1a7aea5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-10087224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9920f3cb902f491b848d660c757eab49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732fb6f-0b", "ovs_interfaceid": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.policy [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcfabcfa53a840b68e154b271703efe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e4af021f9f4272a0bf0f4f35e9d65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Releasing lock "refresh_cache-7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Instance network_info: |[{"id": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "address": "fa:16:3e:69:f1:a6", "network": {"id": "dfc5cc02-1e20-49c8-b735-f79be1a7aea5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-10087224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9920f3cb902f491b848d660c757eab49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732fb6f-0b", "ovs_interfaceid": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1734a69f-7d6f-4056-8ecf-86b41058383d req-6244c45b-37de-47e5-a37b-84cda4fe8993 service nova] Acquired lock "refresh_cache-7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-1734a69f-7d6f-4056-8ecf-86b41058383d req-6244c45b-37de-47e5-a37b-84cda4fe8993 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Refreshing network info cache for port 1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Start _get_guest_xml network_info=[{"id": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "address": "fa:16:3e:69:f1:a6", "network": {"id": "dfc5cc02-1e20-49c8-b735-f79be1a7aea5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-10087224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9920f3cb902f491b848d660c757eab49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732fb6f-0b", "ovs_interfaceid": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.203s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:43 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:47:43 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk 1073741824" returned: 0 in 0.057s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-187072227',display_name='tempest-DeleteServersTestJSON-server-187072227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-187072227',id=2,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9920f3cb902f491b848d660c757eab49',ramdisk_id='',reservation_id='r-s4nc2rx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1142355133',owner_user_name='tempest-DeleteServersTestJSON-1142355133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:47:38Z,user_data=None,user_id='be1459c348da4131bb1c97ceba21bdd4',uuid=7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "address": "fa:16:3e:69:f1:a6", "network": {"id": "dfc5cc02-1e20-49c8-b735-f79be1a7aea5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-10087224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9920f3cb902f491b848d660c757eab49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732fb6f-0b", "ovs_interfaceid": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Converting VIF {"id": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "address": "fa:16:3e:69:f1:a6", "network": {"id": "dfc5cc02-1e20-49c8-b735-f79be1a7aea5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-10087224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9920f3cb902f491b848d660c757eab49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732fb6f-0b", "ovs_interfaceid": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:a6,bridge_name='br-int',has_traffic_filtering=True,id=1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd,network=Network(dfc5cc02-1e20-49c8-b735-f79be1a7aea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1732fb6f-0b') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.objects.instance [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.245s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:47:43 user nova-compute[75813]:   <uuid>7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3</uuid>
Nov 15 12:47:43 user nova-compute[75813]:   <name>instance-00000002</name>
Nov 15 12:47:43 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:47:43 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:47:43 user nova-compute[75813]:   <metadata>
Nov 15 12:47:43 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:47:43 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:47:43 user nova-compute[75813]:       <nova:name>tempest-DeleteServersTestJSON-server-187072227</nova:name>
Nov 15 12:47:43 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:47:43</nova:creationTime>
Nov 15 12:47:43 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:47:43 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:47:43 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:47:43 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:47:43 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:47:43 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:47:43 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:47:43 user nova-compute[75813]:       <nova:owner>
Nov 15 12:47:43 user nova-compute[75813]:         <nova:user uuid="be1459c348da4131bb1c97ceba21bdd4">tempest-DeleteServersTestJSON-1142355133-project-member</nova:user>
Nov 15 12:47:43 user nova-compute[75813]:         <nova:project uuid="9920f3cb902f491b848d660c757eab49">tempest-DeleteServersTestJSON-1142355133</nova:project>
Nov 15 12:47:43 user nova-compute[75813]:       </nova:owner>
Nov 15 12:47:43 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:47:43 user nova-compute[75813]:       <nova:ports>
Nov 15 12:47:43 user nova-compute[75813]:         <nova:port uuid="1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd">
Nov 15 12:47:43 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 12:47:43 user nova-compute[75813]:         </nova:port>
Nov 15 12:47:43 user nova-compute[75813]:       </nova:ports>
Nov 15 12:47:43 user nova-compute[75813]:     </nova:instance>
Nov 15 12:47:43 user nova-compute[75813]:   </metadata>
Nov 15 12:47:43 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:47:43 user nova-compute[75813]:     <system>
Nov 15 12:47:43 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:47:43 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:47:43 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:47:43 user nova-compute[75813]:       <entry name="serial">7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3</entry>
Nov 15 12:47:43 user nova-compute[75813]:       <entry name="uuid">7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3</entry>
Nov 15 12:47:43 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:47:43 user nova-compute[75813]:     </system>
Nov 15 12:47:43 user nova-compute[75813]:   </sysinfo>
Nov 15 12:47:43 user nova-compute[75813]:   <os>
Nov 15 12:47:43 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:47:43 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:47:43 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:47:43 user nova-compute[75813]:   </os>
Nov 15 12:47:43 user nova-compute[75813]:   <features>
Nov 15 12:47:43 user nova-compute[75813]:     <acpi/>
Nov 15 12:47:43 user nova-compute[75813]:     <apic/>
Nov 15 12:47:43 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:47:43 user nova-compute[75813]:   </features>
Nov 15 12:47:43 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:47:43 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:47:43 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:47:43 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:47:43 user nova-compute[75813]:   </clock>
Nov 15 12:47:43 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:47:43 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:47:43 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:47:43 user nova-compute[75813]:   </cpu>
Nov 15 12:47:43 user nova-compute[75813]:   <devices>
Nov 15 12:47:43 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:47:43 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:47:43 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk"/>
Nov 15 12:47:43 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:47:43 user nova-compute[75813]:     </disk>
Nov 15 12:47:43 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:47:43 user nova-compute[75813]:       <mac address="fa:16:3e:69:f1:a6"/>
Nov 15 12:47:43 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:47:43 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:47:43 user nova-compute[75813]:       <target dev="tap1732fb6f-0b"/>
Nov 15 12:47:43 user nova-compute[75813]:     </interface>
Nov 15 12:47:43 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:47:43 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/console.log" append="off"/>
Nov 15 12:47:43 user nova-compute[75813]:     </serial>
Nov 15 12:47:43 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:47:43 user nova-compute[75813]:     <video>
Nov 15 12:47:43 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:47:43 user nova-compute[75813]:     </video>
Nov 15 12:47:43 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:47:43 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:47:43 user nova-compute[75813]:     </rng>
Nov 15 12:47:43 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:47:43 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:47:43 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:47:43 user nova-compute[75813]:     </memballoon>
Nov 15 12:47:43 user nova-compute[75813]:   </devices>
Nov 15 12:47:43 user nova-compute[75813]: </domain>
Nov 15 12:47:43 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-187072227',display_name='tempest-DeleteServersTestJSON-server-187072227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-187072227',id=2,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9920f3cb902f491b848d660c757eab49',ramdisk_id='',reservation_id='r-s4nc2rx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1142355133',owner_user_name='tempest-DeleteServersTestJSON-1142355133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:47:38Z,user_data=None,user_id='be1459c348da4131bb1c97ceba21bdd4',uuid=7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "address": "fa:16:3e:69:f1:a6", "network": {"id": "dfc5cc02-1e20-49c8-b735-f79be1a7aea5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-10087224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9920f3cb902f491b848d660c757eab49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732fb6f-0b", "ovs_interfaceid": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Converting VIF {"id": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "address": "fa:16:3e:69:f1:a6", "network": {"id": "dfc5cc02-1e20-49c8-b735-f79be1a7aea5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-10087224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9920f3cb902f491b848d660c757eab49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732fb6f-0b", "ovs_interfaceid": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:a6,bridge_name='br-int',has_traffic_filtering=True,id=1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd,network=Network(dfc5cc02-1e20-49c8-b735-f79be1a7aea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1732fb6f-0b') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG os_vif [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:a6,bridge_name='br-int',has_traffic_filtering=True,id=1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd,network=Network(dfc5cc02-1e20-49c8-b735-f79be1a7aea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1732fb6f-0b') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c087913c-2fa2-5d56-9cc9-9fa3165cda02', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.186s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap460a944c-a9, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap460a944c-a9, col_values=(('qos', UUID('98b78259-bca0-4903-bec2-633393062aa7')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap460a944c-a9, col_values=(('external_ids', {'iface-id': '460a944c-a9e9-43e9-9a0a-c071cbf471e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:8c:02', 'vm-uuid': '870cf760-ae0c-4df1-99cf-6403d8e642ce'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk 1073741824" returned: 0 in 0.053s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:44 user nova-compute[75813]: INFO os_vif [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:8c:02,bridge_name='br-int',has_traffic_filtering=True,id=460a944c-a9e9-43e9-9a0a-c071cbf471e4,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460a944c-a9')
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1732fb6f-0b, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1732fb6f-0b, col_values=(('qos', UUID('d7846ea1-d6a4-45d8-80a0-de3d2ec5a0df')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1732fb6f-0b, col_values=(('external_ids', {'iface-id': '1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:f1:a6', 'vm-uuid': '7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Cannot resize image /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Ensure instance console log exists: /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:44 user nova-compute[75813]: INFO os_vif [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:a6,bridge_name='br-int',has_traffic_filtering=True,id=1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd,network=Network(dfc5cc02-1e20-49c8-b735-f79be1a7aea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1732fb6f-0b')
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] No VIF found with MAC fa:16:3e:23:8c:02, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] No VIF found with MAC fa:16:3e:69:f1:a6, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.216s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Cannot resize image /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Ensure instance console log exists: /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.network.neutron [req-1734a69f-7d6f-4056-8ecf-86b41058383d req-6244c45b-37de-47e5-a37b-84cda4fe8993 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Updated VIF entry in instance network info cache for port 1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.network.neutron [req-1734a69f-7d6f-4056-8ecf-86b41058383d req-6244c45b-37de-47e5-a37b-84cda4fe8993 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Updating instance_info_cache with network_info: [{"id": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "address": "fa:16:3e:69:f1:a6", "network": {"id": "dfc5cc02-1e20-49c8-b735-f79be1a7aea5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-10087224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9920f3cb902f491b848d660c757eab49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732fb6f-0b", "ovs_interfaceid": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1734a69f-7d6f-4056-8ecf-86b41058383d req-6244c45b-37de-47e5-a37b-84cda4fe8993 service nova] Releasing lock "refresh_cache-7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Successfully created port: 63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:47:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Successfully created port: 1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:47:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Successfully updated port: 63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:47:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:47:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquired lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:47:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:47:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-48d851f5-c21d-4bda-a803-f22ae1fb05de req-a4acdc80-4826-48c6-a6d8-ab9961de19e8 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Received event network-changed-63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:47:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-48d851f5-c21d-4bda-a803-f22ae1fb05de req-a4acdc80-4826-48c6-a6d8-ab9961de19e8 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Refreshing instance network info cache due to event network-changed-63994e7d-b489-40f0-8233-d6f6313be4ad. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:47:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-48d851f5-c21d-4bda-a803-f22ae1fb05de req-a4acdc80-4826-48c6-a6d8-ab9961de19e8 service nova] Acquiring lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Successfully updated port: 1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquired lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Updating instance_info_cache with network_info: [{"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Releasing lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Instance network_info: |[{"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-48d851f5-c21d-4bda-a803-f22ae1fb05de req-a4acdc80-4826-48c6-a6d8-ab9961de19e8 service nova] Acquired lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.network.neutron [req-48d851f5-c21d-4bda-a803-f22ae1fb05de req-a4acdc80-4826-48c6-a6d8-ab9961de19e8 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Refreshing network info cache for port 63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Start _get_guest_xml network_info=[{"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:47:46 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1511120876',display_name='tempest-AttachVolumeNegativeTest-server-1511120876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1511120876',id=3,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGYvlE6LK1uNKAG8XjzT6P/kpINMuPFXsxmQtweOD9s8QQNC8Jb/OjEfgk7So9RcZKEsTxHNtet5rFt45zjWd1nQUIeZ1sfNcMlxtN49JoGZsEw4YU2XZAICb99gsg+qA==',key_name='tempest-keypair-1690714560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-qixcnjhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=48d7cb39-a436-4b01-87cc-77e917ac5c0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a6:95,bridge_name='br-int',has_traffic_filtering=True,id=63994e7d-b489-40f0-8233-d6f6313be4ad,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63994e7d-b4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.objects.instance [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'pci_devices' on Instance uuid 48d7cb39-a436-4b01-87cc-77e917ac5c0e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:47:46 user nova-compute[75813]:   <uuid>48d7cb39-a436-4b01-87cc-77e917ac5c0e</uuid>
Nov 15 12:47:46 user nova-compute[75813]:   <name>instance-00000003</name>
Nov 15 12:47:46 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:47:46 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:47:46 user nova-compute[75813]:   <metadata>
Nov 15 12:47:46 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:47:46 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:47:46 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1511120876</nova:name>
Nov 15 12:47:46 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:47:46</nova:creationTime>
Nov 15 12:47:46 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:47:46 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:47:46 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:47:46 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:47:46 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:47:46 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:47:46 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:47:46 user nova-compute[75813]:       <nova:owner>
Nov 15 12:47:46 user nova-compute[75813]:         <nova:user uuid="66e8cb4b92ee40b9875ac675ec63b982">tempest-AttachVolumeNegativeTest-1316863353-project-member</nova:user>
Nov 15 12:47:46 user nova-compute[75813]:         <nova:project uuid="9cb2a7b27b904d639b7df886781d587f">tempest-AttachVolumeNegativeTest-1316863353</nova:project>
Nov 15 12:47:46 user nova-compute[75813]:       </nova:owner>
Nov 15 12:47:46 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:47:46 user nova-compute[75813]:       <nova:ports>
Nov 15 12:47:46 user nova-compute[75813]:         <nova:port uuid="63994e7d-b489-40f0-8233-d6f6313be4ad">
Nov 15 12:47:46 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 12:47:46 user nova-compute[75813]:         </nova:port>
Nov 15 12:47:46 user nova-compute[75813]:       </nova:ports>
Nov 15 12:47:46 user nova-compute[75813]:     </nova:instance>
Nov 15 12:47:46 user nova-compute[75813]:   </metadata>
Nov 15 12:47:46 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:47:46 user nova-compute[75813]:     <system>
Nov 15 12:47:46 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:47:46 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:47:46 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:47:46 user nova-compute[75813]:       <entry name="serial">48d7cb39-a436-4b01-87cc-77e917ac5c0e</entry>
Nov 15 12:47:46 user nova-compute[75813]:       <entry name="uuid">48d7cb39-a436-4b01-87cc-77e917ac5c0e</entry>
Nov 15 12:47:46 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:47:46 user nova-compute[75813]:     </system>
Nov 15 12:47:46 user nova-compute[75813]:   </sysinfo>
Nov 15 12:47:46 user nova-compute[75813]:   <os>
Nov 15 12:47:46 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:47:46 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:47:46 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:47:46 user nova-compute[75813]:   </os>
Nov 15 12:47:46 user nova-compute[75813]:   <features>
Nov 15 12:47:46 user nova-compute[75813]:     <acpi/>
Nov 15 12:47:46 user nova-compute[75813]:     <apic/>
Nov 15 12:47:46 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:47:46 user nova-compute[75813]:   </features>
Nov 15 12:47:46 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:47:46 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:47:46 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:47:46 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:47:46 user nova-compute[75813]:   </clock>
Nov 15 12:47:46 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:47:46 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:47:46 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:47:46 user nova-compute[75813]:   </cpu>
Nov 15 12:47:46 user nova-compute[75813]:   <devices>
Nov 15 12:47:46 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:47:46 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:47:46 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk"/>
Nov 15 12:47:46 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:47:46 user nova-compute[75813]:     </disk>
Nov 15 12:47:46 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:47:46 user nova-compute[75813]:       <mac address="fa:16:3e:f0:a6:95"/>
Nov 15 12:47:46 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:47:46 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:47:46 user nova-compute[75813]:       <target dev="tap63994e7d-b4"/>
Nov 15 12:47:46 user nova-compute[75813]:     </interface>
Nov 15 12:47:46 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:47:46 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/console.log" append="off"/>
Nov 15 12:47:46 user nova-compute[75813]:     </serial>
Nov 15 12:47:46 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:47:46 user nova-compute[75813]:     <video>
Nov 15 12:47:46 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:47:46 user nova-compute[75813]:     </video>
Nov 15 12:47:46 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:47:46 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:47:46 user nova-compute[75813]:     </rng>
Nov 15 12:47:46 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:47:46 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:47:46 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:47:46 user nova-compute[75813]:     </memballoon>
Nov 15 12:47:46 user nova-compute[75813]:   </devices>
Nov 15 12:47:46 user nova-compute[75813]: </domain>
Nov 15 12:47:46 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1511120876',display_name='tempest-AttachVolumeNegativeTest-server-1511120876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1511120876',id=3,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGYvlE6LK1uNKAG8XjzT6P/kpINMuPFXsxmQtweOD9s8QQNC8Jb/OjEfgk7So9RcZKEsTxHNtet5rFt45zjWd1nQUIeZ1sfNcMlxtN49JoGZsEw4YU2XZAICb99gsg+qA==',key_name='tempest-keypair-1690714560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-qixcnjhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=48d7cb39-a436-4b01-87cc-77e917ac5c0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a6:95,bridge_name='br-int',has_traffic_filtering=True,id=63994e7d-b489-40f0-8233-d6f6313be4ad,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63994e7d-b4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG os_vif [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a6:95,bridge_name='br-int',has_traffic_filtering=True,id=63994e7d-b489-40f0-8233-d6f6313be4ad,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63994e7d-b4') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd4e72de-eee5-5fb4-9cef-54abf57b60b5', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63994e7d-b4, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63994e7d-b4, col_values=(('qos', UUID('471c61e1-dc3a-4472-91ad-b21c6729183c')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63994e7d-b4, col_values=(('external_ids', {'iface-id': '63994e7d-b489-40f0-8233-d6f6313be4ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:a6:95', 'vm-uuid': '48d7cb39-a436-4b01-87cc-77e917ac5c0e'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: INFO os_vif [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a6:95,bridge_name='br-int',has_traffic_filtering=True,id=63994e7d-b489-40f0-8233-d6f6313be4ad,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63994e7d-b4')
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No VIF found with MAC fa:16:3e:f0:a6:95, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-047e1e62-3f58-4f96-b363-e571754443b6 req-c8047578-fb83-4c11-b8c3-75f925d64bb5 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-changed-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-047e1e62-3f58-4f96-b363-e571754443b6 req-c8047578-fb83-4c11-b8c3-75f925d64bb5 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Refreshing instance network info cache due to event network-changed-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-047e1e62-3f58-4f96-b363-e571754443b6 req-c8047578-fb83-4c11-b8c3-75f925d64bb5 service nova] Acquiring lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating instance_info_cache with network_info: [{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Releasing lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance network_info: |[{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-047e1e62-3f58-4f96-b363-e571754443b6 req-c8047578-fb83-4c11-b8c3-75f925d64bb5 service nova] Acquired lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-047e1e62-3f58-4f96-b363-e571754443b6 req-c8047578-fb83-4c11-b8c3-75f925d64bb5 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Refreshing network info cache for port 1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Start _get_guest_xml network_info=[{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:47:47 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:47:47 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1881026575',display_name='tempest-ServerActionsTestOtherB-server-1881026575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1881026575',id=4,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnZCP66OrHRDZ3ufYGtTWYdbRBSuBJje4iccBj6qLgISdaiqkf+oj6TVWJiVhyyqw9aCzwVAnqyqjl+t9sQMq2PFBTOdf/G6orxxQMji4Jiz+kT9TtRhqkc6tVuBEXETA==',key_name='tempest-keypair-296274020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e4af021f9f4272a0bf0f4f35e9d65a',ramdisk_id='',reservation_id='r-32pd9cde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1149556653',owner_user_name='tempest-ServerActionsTestOtherB-1149556653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfabcfa53a840b68e154b271703efe7',uuid=36b32262-4ea0-4a33-9672-82c7b8061bb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converting VIF {"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.objects.instance [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lazy-loading 'pci_devices' on Instance uuid 36b32262-4ea0-4a33-9672-82c7b8061bb1 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:47:47 user nova-compute[75813]:   <uuid>36b32262-4ea0-4a33-9672-82c7b8061bb1</uuid>
Nov 15 12:47:47 user nova-compute[75813]:   <name>instance-00000004</name>
Nov 15 12:47:47 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:47:47 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:47:47 user nova-compute[75813]:   <metadata>
Nov 15 12:47:47 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:47:47 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:47:47 user nova-compute[75813]:       <nova:name>tempest-ServerActionsTestOtherB-server-1881026575</nova:name>
Nov 15 12:47:47 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:47:47</nova:creationTime>
Nov 15 12:47:47 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:47:47 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:47:47 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:47:47 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:47:47 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:47:47 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:47:47 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:47:47 user nova-compute[75813]:       <nova:owner>
Nov 15 12:47:47 user nova-compute[75813]:         <nova:user uuid="bcfabcfa53a840b68e154b271703efe7">tempest-ServerActionsTestOtherB-1149556653-project-member</nova:user>
Nov 15 12:47:47 user nova-compute[75813]:         <nova:project uuid="44e4af021f9f4272a0bf0f4f35e9d65a">tempest-ServerActionsTestOtherB-1149556653</nova:project>
Nov 15 12:47:47 user nova-compute[75813]:       </nova:owner>
Nov 15 12:47:47 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:47:47 user nova-compute[75813]:       <nova:ports>
Nov 15 12:47:47 user nova-compute[75813]:         <nova:port uuid="1d4549cc-1d5a-4548-86d8-1832e8ce3d4c">
Nov 15 12:47:47 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 12:47:47 user nova-compute[75813]:         </nova:port>
Nov 15 12:47:47 user nova-compute[75813]:       </nova:ports>
Nov 15 12:47:47 user nova-compute[75813]:     </nova:instance>
Nov 15 12:47:47 user nova-compute[75813]:   </metadata>
Nov 15 12:47:47 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:47:47 user nova-compute[75813]:     <system>
Nov 15 12:47:47 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:47:47 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:47:47 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:47:47 user nova-compute[75813]:       <entry name="serial">36b32262-4ea0-4a33-9672-82c7b8061bb1</entry>
Nov 15 12:47:47 user nova-compute[75813]:       <entry name="uuid">36b32262-4ea0-4a33-9672-82c7b8061bb1</entry>
Nov 15 12:47:47 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:47:47 user nova-compute[75813]:     </system>
Nov 15 12:47:47 user nova-compute[75813]:   </sysinfo>
Nov 15 12:47:47 user nova-compute[75813]:   <os>
Nov 15 12:47:47 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:47:47 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:47:47 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:47:47 user nova-compute[75813]:   </os>
Nov 15 12:47:47 user nova-compute[75813]:   <features>
Nov 15 12:47:47 user nova-compute[75813]:     <acpi/>
Nov 15 12:47:47 user nova-compute[75813]:     <apic/>
Nov 15 12:47:47 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:47:47 user nova-compute[75813]:   </features>
Nov 15 12:47:47 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:47:47 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:47:47 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:47:47 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:47:47 user nova-compute[75813]:   </clock>
Nov 15 12:47:47 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:47:47 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:47:47 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:47:47 user nova-compute[75813]:   </cpu>
Nov 15 12:47:47 user nova-compute[75813]:   <devices>
Nov 15 12:47:47 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:47:47 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:47:47 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk"/>
Nov 15 12:47:47 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:47:47 user nova-compute[75813]:     </disk>
Nov 15 12:47:47 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:47:47 user nova-compute[75813]:       <mac address="fa:16:3e:b7:0c:d8"/>
Nov 15 12:47:47 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:47:47 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:47:47 user nova-compute[75813]:       <target dev="tap1d4549cc-1d"/>
Nov 15 12:47:47 user nova-compute[75813]:     </interface>
Nov 15 12:47:47 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:47:47 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/console.log" append="off"/>
Nov 15 12:47:47 user nova-compute[75813]:     </serial>
Nov 15 12:47:47 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:47:47 user nova-compute[75813]:     <video>
Nov 15 12:47:47 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:47:47 user nova-compute[75813]:     </video>
Nov 15 12:47:47 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:47:47 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:47:47 user nova-compute[75813]:     </rng>
Nov 15 12:47:47 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:47:47 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:47:47 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:47:47 user nova-compute[75813]:     </memballoon>
Nov 15 12:47:47 user nova-compute[75813]:   </devices>
Nov 15 12:47:47 user nova-compute[75813]: </domain>
Nov 15 12:47:47 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1881026575',display_name='tempest-ServerActionsTestOtherB-server-1881026575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1881026575',id=4,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnZCP66OrHRDZ3ufYGtTWYdbRBSuBJje4iccBj6qLgISdaiqkf+oj6TVWJiVhyyqw9aCzwVAnqyqjl+t9sQMq2PFBTOdf/G6orxxQMji4Jiz+kT9TtRhqkc6tVuBEXETA==',key_name='tempest-keypair-296274020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e4af021f9f4272a0bf0f4f35e9d65a',ramdisk_id='',reservation_id='r-32pd9cde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1149556653',owner_user_name='tempest-ServerActionsTestOtherB-1149556653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfabcfa53a840b68e154b271703efe7',uuid=36b32262-4ea0-4a33-9672-82c7b8061bb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converting VIF {"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG os_vif [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '375affc4-2f58-5c8c-a7b6-868eec2195d4', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d4549cc-1d, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d4549cc-1d, col_values=(('qos', UUID('f9ba5edf-4a7e-4cd4-bd17-86b02a9cda68')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d4549cc-1d, col_values=(('external_ids', {'iface-id': '1d4549cc-1d5a-4548-86d8-1832e8ce3d4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:0c:d8', 'vm-uuid': '36b32262-4ea0-4a33-9672-82c7b8061bb1'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:47 user nova-compute[75813]: INFO os_vif [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d')
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] No VIF found with MAC fa:16:3e:b7:0c:d8, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-48d851f5-c21d-4bda-a803-f22ae1fb05de req-a4acdc80-4826-48c6-a6d8-ab9961de19e8 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Updated VIF entry in instance network info cache for port 63994e7d-b489-40f0-8233-d6f6313be4ad. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-48d851f5-c21d-4bda-a803-f22ae1fb05de req-a4acdc80-4826-48c6-a6d8-ab9961de19e8 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Updating instance_info_cache with network_info: [{"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-48d851f5-c21d-4bda-a803-f22ae1fb05de req-a4acdc80-4826-48c6-a6d8-ab9961de19e8 service nova] Releasing lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-047e1e62-3f58-4f96-b363-e571754443b6 req-c8047578-fb83-4c11-b8c3-75f925d64bb5 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updated VIF entry in instance network info cache for port 1d4549cc-1d5a-4548-86d8-1832e8ce3d4c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-047e1e62-3f58-4f96-b363-e571754443b6 req-c8047578-fb83-4c11-b8c3-75f925d64bb5 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating instance_info_cache with network_info: [{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:47:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-047e1e62-3f58-4f96-b363-e571754443b6 req-c8047578-fb83-4c11-b8c3-75f925d64bb5 service nova] Releasing lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:47:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Received event network-vif-plugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:47:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] Acquiring lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] No waiting events found dispatching network-vif-plugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:47:48 user nova-compute[75813]: WARNING nova.compute.manager [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Received unexpected event network-vif-plugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 for instance with vm_state building and task_state spawning.
Nov 15 12:47:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Received event network-vif-plugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:47:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] Acquiring lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] No waiting events found dispatching network-vif-plugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:47:48 user nova-compute[75813]: WARNING nova.compute.manager [req-24bac558-3f1d-4e4f-984d-7a4a29ae79aa req-f0e3ee0a-ba03-41fb-bb44-f48fd9483435 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Received unexpected event network-vif-plugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 for instance with vm_state building and task_state spawning.
Nov 15 12:47:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:47:50 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Instance spawned successfully.
Nov 15 12:47:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:50 user nova-compute[75813]: INFO nova.compute.manager [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Took 12.73 seconds to spawn the instance on the hypervisor.
Nov 15 12:47:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:47:51 user nova-compute[75813]: INFO nova.compute.manager [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Took 13.59 seconds to build instance.
Nov 15 12:47:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f332689a-7546-4e96-b9e5-921fb0ae09de tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.769s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:47:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:47:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Instance spawned successfully.
Nov 15 12:47:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:47:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:51 user nova-compute[75813]: INFO nova.compute.manager [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Took 16.78 seconds to spawn the instance on the hypervisor.
Nov 15 12:47:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:47:51 user nova-compute[75813]: INFO nova.compute.manager [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Took 18.14 seconds to build instance.
Nov 15 12:47:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa96f1c4-4e65-4afe-9f0f-1ff79bd0ce4a tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.430s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:47:53 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance spawned successfully.
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:47:53 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Instance spawned successfully.
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:47:53 user nova-compute[75813]: INFO nova.compute.manager [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Took 10.25 seconds to spawn the instance on the hypervisor.
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:47:53 user nova-compute[75813]: INFO nova.compute.manager [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Took 11.34 seconds to build instance.
Nov 15 12:47:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-edd1a11e-9888-45c4-a62f-9d960601314e tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.526s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:54 user nova-compute[75813]: INFO nova.compute.manager [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Took 10.89 seconds to spawn the instance on the hypervisor.
Nov 15 12:47:54 user nova-compute[75813]: DEBUG nova.compute.manager [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:47:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:54 user nova-compute[75813]: INFO nova.compute.manager [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Took 11.97 seconds to build instance.
Nov 15 12:47:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-62e16f37-0fad-459a-bf97-3112d99a504a tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.125s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:55 user nova-compute[75813]: DEBUG nova.compute.manager [req-9db998fe-6218-464f-9a91-183805375aaa req-568792f1-2a3e-45e1-9113-94c4faf9652b service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:47:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9db998fe-6218-464f-9a91-183805375aaa req-568792f1-2a3e-45e1-9113-94c4faf9652b service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9db998fe-6218-464f-9a91-183805375aaa req-568792f1-2a3e-45e1-9113-94c4faf9652b service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9db998fe-6218-464f-9a91-183805375aaa req-568792f1-2a3e-45e1-9113-94c4faf9652b service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:55 user nova-compute[75813]: DEBUG nova.compute.manager [req-9db998fe-6218-464f-9a91-183805375aaa req-568792f1-2a3e-45e1-9113-94c4faf9652b service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:47:55 user nova-compute[75813]: WARNING nova.compute.manager [req-9db998fe-6218-464f-9a91-183805375aaa req-568792f1-2a3e-45e1-9113-94c4faf9652b service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received unexpected event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with vm_state active and task_state None.
Nov 15 12:47:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:57 user nova-compute[75813]: DEBUG nova.compute.manager [req-8e89eddc-8b3e-45c9-9706-25448df87c16 req-22426923-1371-45e9-b554-ac99079042b8 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:47:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8e89eddc-8b3e-45c9-9706-25448df87c16 req-22426923-1371-45e9-b554-ac99079042b8 service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8e89eddc-8b3e-45c9-9706-25448df87c16 req-22426923-1371-45e9-b554-ac99079042b8 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8e89eddc-8b3e-45c9-9706-25448df87c16 req-22426923-1371-45e9-b554-ac99079042b8 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:57 user nova-compute[75813]: DEBUG nova.compute.manager [req-8e89eddc-8b3e-45c9-9706-25448df87c16 req-22426923-1371-45e9-b554-ac99079042b8 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:47:57 user nova-compute[75813]: WARNING nova.compute.manager [req-8e89eddc-8b3e-45c9-9706-25448df87c16 req-22426923-1371-45e9-b554-ac99079042b8 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received unexpected event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with vm_state active and task_state None.
Nov 15 12:47:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:47:58 user nova-compute[75813]: INFO nova.compute.claims [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Claim successful on node user
Nov 15 12:47:58 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:47:58 user nova-compute[75813]: DEBUG nova.network.neutron [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:47:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:47:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG nova.policy [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e917cad7442343d9927b1cee60d221c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec31cbd1cad4e7cb23e1fb4616b00c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:47:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Creating image(s)
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "/opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "/opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.278s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.315s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk 1073741824" returned: 0 in 0.073s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.401s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:47:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.298s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Cannot resize image /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Ensure instance console log exists: /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:00 user nova-compute[75813]: DEBUG nova.network.neutron [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Successfully created port: 96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:48:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-ba5ddc4c-22d0-4181-a789-3e74f36e9681 req-54f0e5cd-4062-4b24-9354-620b72ec9ec3 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Received event network-vif-plugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ba5ddc4c-22d0-4181-a789-3e74f36e9681 req-54f0e5cd-4062-4b24-9354-620b72ec9ec3 service nova] Acquiring lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ba5ddc4c-22d0-4181-a789-3e74f36e9681 req-54f0e5cd-4062-4b24-9354-620b72ec9ec3 service nova] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ba5ddc4c-22d0-4181-a789-3e74f36e9681 req-54f0e5cd-4062-4b24-9354-620b72ec9ec3 service nova] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-ba5ddc4c-22d0-4181-a789-3e74f36e9681 req-54f0e5cd-4062-4b24-9354-620b72ec9ec3 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] No waiting events found dispatching network-vif-plugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:01 user nova-compute[75813]: WARNING nova.compute.manager [req-ba5ddc4c-22d0-4181-a789-3e74f36e9681 req-54f0e5cd-4062-4b24-9354-620b72ec9ec3 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Received unexpected event network-vif-plugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd for instance with vm_state active and task_state None.
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Successfully updated port: 96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "refresh_cache-ec571e3e-90e0-47d4-b1ae-98a356dc43f6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquired lock "refresh_cache-ec571e3e-90e0-47d4-b1ae-98a356dc43f6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-6fa725ea-65c9-4388-b86d-faa9bf121b01 req-3d15669b-47de-4ec2-9148-b36cc285f69a service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Received event network-changed-96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-6fa725ea-65c9-4388-b86d-faa9bf121b01 req-3d15669b-47de-4ec2-9148-b36cc285f69a service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Refreshing instance network info cache due to event network-changed-96d6bc55-a485-4bfe-8bc5-b6978bababb3. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6fa725ea-65c9-4388-b86d-faa9bf121b01 req-3d15669b-47de-4ec2-9148-b36cc285f69a service nova] Acquiring lock "refresh_cache-ec571e3e-90e0-47d4-b1ae-98a356dc43f6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "43f11322-00e7-472d-91f9-48ac1b16f33c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:48:02 user nova-compute[75813]: INFO nova.compute.claims [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Claim successful on node user
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Updating instance_info_cache with network_info: [{"id": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "address": "fa:16:3e:b3:d6:37", "network": {"id": "ad54a03a-4017-4bdf-8b27-2fee2d038d2d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1945739865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec31cbd1cad4e7cb23e1fb4616b00c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d6bc55-a4", "ovs_interfaceid": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Releasing lock "refresh_cache-ec571e3e-90e0-47d4-b1ae-98a356dc43f6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Instance network_info: |[{"id": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "address": "fa:16:3e:b3:d6:37", "network": {"id": "ad54a03a-4017-4bdf-8b27-2fee2d038d2d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1945739865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec31cbd1cad4e7cb23e1fb4616b00c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d6bc55-a4", "ovs_interfaceid": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6fa725ea-65c9-4388-b86d-faa9bf121b01 req-3d15669b-47de-4ec2-9148-b36cc285f69a service nova] Acquired lock "refresh_cache-ec571e3e-90e0-47d4-b1ae-98a356dc43f6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.network.neutron [req-6fa725ea-65c9-4388-b86d-faa9bf121b01 req-3d15669b-47de-4ec2-9148-b36cc285f69a service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Refreshing network info cache for port 96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Start _get_guest_xml network_info=[{"id": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "address": "fa:16:3e:b3:d6:37", "network": {"id": "ad54a03a-4017-4bdf-8b27-2fee2d038d2d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1945739865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec31cbd1cad4e7cb23e1fb4616b00c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d6bc55-a4", "ovs_interfaceid": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:48:02 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:02 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1624136279',display_name='tempest-TestVolumeSwap-server-1624136279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1624136279',id=5,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbLoQ1y8xYEofh6p1JVunwap9/uY/rmeKT758ldhZK5dT0enA4RhmL7unHJcHlvVKON3Pyf9gA1nxrRoHuzRsNp00OsYIafvfQq/D1aFac+8SapUThWLfpEgcB+Us3TTw==',key_name='tempest-keypair-971338812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec31cbd1cad4e7cb23e1fb4616b00c4',ramdisk_id='',reservation_id='r-6hkka86w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1733659781',owner_user_name='tempest-TestVolumeSwap-1733659781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e917cad7442343d9927b1cee60d221c7',uuid=ec571e3e-90e0-47d4-b1ae-98a356dc43f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "address": "fa:16:3e:b3:d6:37", "network": {"id": "ad54a03a-4017-4bdf-8b27-2fee2d038d2d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1945739865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec31cbd1cad4e7cb23e1fb4616b00c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d6bc55-a4", "ovs_interfaceid": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Converting VIF {"id": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "address": "fa:16:3e:b3:d6:37", "network": {"id": "ad54a03a-4017-4bdf-8b27-2fee2d038d2d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1945739865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec31cbd1cad4e7cb23e1fb4616b00c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d6bc55-a4", "ovs_interfaceid": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=96d6bc55-a485-4bfe-8bc5-b6978bababb3,network=Network(ad54a03a-4017-4bdf-8b27-2fee2d038d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d6bc55-a4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:48:02 user nova-compute[75813]: DEBUG nova.objects.instance [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lazy-loading 'pci_devices' on Instance uuid ec571e3e-90e0-47d4-b1ae-98a356dc43f6 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:48:03 user nova-compute[75813]:   <uuid>ec571e3e-90e0-47d4-b1ae-98a356dc43f6</uuid>
Nov 15 12:48:03 user nova-compute[75813]:   <name>instance-00000005</name>
Nov 15 12:48:03 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:48:03 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:48:03 user nova-compute[75813]:   <metadata>
Nov 15 12:48:03 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:48:03 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:48:03 user nova-compute[75813]:       <nova:name>tempest-TestVolumeSwap-server-1624136279</nova:name>
Nov 15 12:48:03 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:48:02</nova:creationTime>
Nov 15 12:48:03 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:48:03 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:48:03 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:48:03 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:48:03 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:48:03 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:48:03 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:48:03 user nova-compute[75813]:       <nova:owner>
Nov 15 12:48:03 user nova-compute[75813]:         <nova:user uuid="e917cad7442343d9927b1cee60d221c7">tempest-TestVolumeSwap-1733659781-project-member</nova:user>
Nov 15 12:48:03 user nova-compute[75813]:         <nova:project uuid="4ec31cbd1cad4e7cb23e1fb4616b00c4">tempest-TestVolumeSwap-1733659781</nova:project>
Nov 15 12:48:03 user nova-compute[75813]:       </nova:owner>
Nov 15 12:48:03 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:48:03 user nova-compute[75813]:       <nova:ports>
Nov 15 12:48:03 user nova-compute[75813]:         <nova:port uuid="96d6bc55-a485-4bfe-8bc5-b6978bababb3">
Nov 15 12:48:03 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 12:48:03 user nova-compute[75813]:         </nova:port>
Nov 15 12:48:03 user nova-compute[75813]:       </nova:ports>
Nov 15 12:48:03 user nova-compute[75813]:     </nova:instance>
Nov 15 12:48:03 user nova-compute[75813]:   </metadata>
Nov 15 12:48:03 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:48:03 user nova-compute[75813]:     <system>
Nov 15 12:48:03 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:48:03 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:48:03 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:48:03 user nova-compute[75813]:       <entry name="serial">ec571e3e-90e0-47d4-b1ae-98a356dc43f6</entry>
Nov 15 12:48:03 user nova-compute[75813]:       <entry name="uuid">ec571e3e-90e0-47d4-b1ae-98a356dc43f6</entry>
Nov 15 12:48:03 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:48:03 user nova-compute[75813]:     </system>
Nov 15 12:48:03 user nova-compute[75813]:   </sysinfo>
Nov 15 12:48:03 user nova-compute[75813]:   <os>
Nov 15 12:48:03 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:48:03 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:48:03 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:48:03 user nova-compute[75813]:   </os>
Nov 15 12:48:03 user nova-compute[75813]:   <features>
Nov 15 12:48:03 user nova-compute[75813]:     <acpi/>
Nov 15 12:48:03 user nova-compute[75813]:     <apic/>
Nov 15 12:48:03 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:48:03 user nova-compute[75813]:   </features>
Nov 15 12:48:03 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:48:03 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:48:03 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:48:03 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:48:03 user nova-compute[75813]:   </clock>
Nov 15 12:48:03 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:48:03 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:48:03 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:48:03 user nova-compute[75813]:   </cpu>
Nov 15 12:48:03 user nova-compute[75813]:   <devices>
Nov 15 12:48:03 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:48:03 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:48:03 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk"/>
Nov 15 12:48:03 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:48:03 user nova-compute[75813]:     </disk>
Nov 15 12:48:03 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:48:03 user nova-compute[75813]:       <mac address="fa:16:3e:b3:d6:37"/>
Nov 15 12:48:03 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:48:03 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:48:03 user nova-compute[75813]:       <target dev="tap96d6bc55-a4"/>
Nov 15 12:48:03 user nova-compute[75813]:     </interface>
Nov 15 12:48:03 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:48:03 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/console.log" append="off"/>
Nov 15 12:48:03 user nova-compute[75813]:     </serial>
Nov 15 12:48:03 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:48:03 user nova-compute[75813]:     <video>
Nov 15 12:48:03 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:48:03 user nova-compute[75813]:     </video>
Nov 15 12:48:03 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:48:03 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:48:03 user nova-compute[75813]:     </rng>
Nov 15 12:48:03 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:48:03 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:48:03 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:48:03 user nova-compute[75813]:     </memballoon>
Nov 15 12:48:03 user nova-compute[75813]:   </devices>
Nov 15 12:48:03 user nova-compute[75813]: </domain>
Nov 15 12:48:03 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1624136279',display_name='tempest-TestVolumeSwap-server-1624136279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1624136279',id=5,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbLoQ1y8xYEofh6p1JVunwap9/uY/rmeKT758ldhZK5dT0enA4RhmL7unHJcHlvVKON3Pyf9gA1nxrRoHuzRsNp00OsYIafvfQq/D1aFac+8SapUThWLfpEgcB+Us3TTw==',key_name='tempest-keypair-971338812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec31cbd1cad4e7cb23e1fb4616b00c4',ramdisk_id='',reservation_id='r-6hkka86w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1733659781',owner_user_name='tempest-TestVolumeSwap-1733659781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e917cad7442343d9927b1cee60d221c7',uuid=ec571e3e-90e0-47d4-b1ae-98a356dc43f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "address": "fa:16:3e:b3:d6:37", "network": {"id": "ad54a03a-4017-4bdf-8b27-2fee2d038d2d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1945739865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec31cbd1cad4e7cb23e1fb4616b00c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d6bc55-a4", "ovs_interfaceid": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Converting VIF {"id": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "address": "fa:16:3e:b3:d6:37", "network": {"id": "ad54a03a-4017-4bdf-8b27-2fee2d038d2d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1945739865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec31cbd1cad4e7cb23e1fb4616b00c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d6bc55-a4", "ovs_interfaceid": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=96d6bc55-a485-4bfe-8bc5-b6978bababb3,network=Network(ad54a03a-4017-4bdf-8b27-2fee2d038d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d6bc55-a4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG os_vif [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=96d6bc55-a485-4bfe-8bc5-b6978bababb3,network=Network(ad54a03a-4017-4bdf-8b27-2fee2d038d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d6bc55-a4') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7c2c7fe-8cea-5403-9346-b50026532722', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96d6bc55-a4, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96d6bc55-a4, col_values=(('qos', UUID('3d5c3c95-04d5-4297-8e71-af5f2b72dff8')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96d6bc55-a4, col_values=(('external_ids', {'iface-id': '96d6bc55-a485-4bfe-8bc5-b6978bababb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:d6:37', 'vm-uuid': 'ec571e3e-90e0-47d4-b1ae-98a356dc43f6'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:03 user nova-compute[75813]: INFO os_vif [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=96d6bc55-a485-4bfe-8bc5-b6978bababb3,network=Network(ad54a03a-4017-4bdf-8b27-2fee2d038d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d6bc55-a4')
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] No VIF found with MAC fa:16:3e:b3:d6:37, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.711s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:48:03 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.policy [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab1d5b225c31426d8b63983387245c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43902590da14baa9aa3dd80ad8ff4dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Received event network-vif-plugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] Acquiring lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] No waiting events found dispatching network-vif-plugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:03 user nova-compute[75813]: WARNING nova.compute.manager [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Received unexpected event network-vif-plugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd for instance with vm_state active and task_state None.
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Received event network-vif-plugged-63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] Acquiring lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] No waiting events found dispatching network-vif-plugged-63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:03 user nova-compute[75813]: WARNING nova.compute.manager [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Received unexpected event network-vif-plugged-63994e7d-b489-40f0-8233-d6f6313be4ad for instance with vm_state active and task_state None.
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Received event network-vif-plugged-63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] Acquiring lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] No waiting events found dispatching network-vif-plugged-63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:03 user nova-compute[75813]: WARNING nova.compute.manager [req-1cd1c9f5-63a1-4d41-bdcb-b67715f38f6e req-10123cae-385f-418a-af49-c9bb254d1d0b service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Received unexpected event network-vif-plugged-63994e7d-b489-40f0-8233-d6f6313be4ad for instance with vm_state active and task_state None.
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:48:03 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Creating image(s)
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "/opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "/opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "/opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "a5140e4ce7ee409e96c5abccfb6a7ab03da93809" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "a5140e4ce7ee409e96c5abccfb6a7ab03da93809" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-6fa725ea-65c9-4388-b86d-faa9bf121b01 req-3d15669b-47de-4ec2-9148-b36cc285f69a service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Updated VIF entry in instance network info cache for port 96d6bc55-a485-4bfe-8bc5-b6978bababb3. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-6fa725ea-65c9-4388-b86d-faa9bf121b01 req-3d15669b-47de-4ec2-9148-b36cc285f69a service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Updating instance_info_cache with network_info: [{"id": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "address": "fa:16:3e:b3:d6:37", "network": {"id": "ad54a03a-4017-4bdf-8b27-2fee2d038d2d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1945739865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec31cbd1cad4e7cb23e1fb4616b00c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d6bc55-a4", "ovs_interfaceid": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:48:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6fa725ea-65c9-4388-b86d-faa9bf121b01 req-3d15669b-47de-4ec2-9148-b36cc285f69a service nova] Releasing lock "refresh_cache-ec571e3e-90e0-47d4-b1ae-98a356dc43f6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:48:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809.part --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:04 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Successfully created port: 7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:48:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809.part --force-share --output=json" returned: 0 in 0.303s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:04 user nova-compute[75813]: DEBUG nova.virt.images [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] c731691c-b724-44ba-ae7f-945af1ab2bd0 was qcow2, converting to raw {{(pid=75813) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 12:48:04 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 12:48:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809.part /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809.converted {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809.part /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809.converted" returned: 0 in 0.361s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809.converted --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-72100a68-8092-4913-98ed-9e4b4cc6a018 req-0d85c1a4-6d92-468d-8336-9f212283d4cd service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Received event network-vif-plugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-72100a68-8092-4913-98ed-9e4b4cc6a018 req-0d85c1a4-6d92-468d-8336-9f212283d4cd service nova] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-72100a68-8092-4913-98ed-9e4b4cc6a018 req-0d85c1a4-6d92-468d-8336-9f212283d4cd service nova] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-72100a68-8092-4913-98ed-9e4b4cc6a018 req-0d85c1a4-6d92-468d-8336-9f212283d4cd service nova] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-72100a68-8092-4913-98ed-9e4b4cc6a018 req-0d85c1a4-6d92-468d-8336-9f212283d4cd service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] No waiting events found dispatching network-vif-plugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:05 user nova-compute[75813]: WARNING nova.compute.manager [req-72100a68-8092-4913-98ed-9e4b4cc6a018 req-0d85c1a4-6d92-468d-8336-9f212283d4cd service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Received unexpected event network-vif-plugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 for instance with vm_state building and task_state spawning.
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809.converted --force-share --output=json" returned: 0 in 0.243s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "a5140e4ce7ee409e96c5abccfb6a7ab03da93809" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.603s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809 --force-share --output=json" returned: 0 in 0.229s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "a5140e4ce7ee409e96c5abccfb6a7ab03da93809" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "a5140e4ce7ee409e96c5abccfb6a7ab03da93809" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809 --force-share --output=json" returned: 0 in 0.266s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809,backing_fmt=raw /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809,backing_fmt=raw /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk 1073741824" returned: 0 in 0.073s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "a5140e4ce7ee409e96c5abccfb6a7ab03da93809" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809 --force-share --output=json" returned: 0 in 0.253s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Successfully updated port: 7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "refresh_cache-43f11322-00e7-472d-91f9-48ac1b16f33c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquired lock "refresh_cache-43f11322-00e7-472d-91f9-48ac1b16f33c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Cannot resize image /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Ensure instance console log exists: /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Acquiring lock "0e47f02a-040d-422f-8847-40eb19df4073" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "0e47f02a-040d-422f-8847-40eb19df4073" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:06 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:48:06 user nova-compute[75813]: INFO nova.compute.claims [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Claim successful on node user
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Updating instance_info_cache with network_info: [{"id": "7e0f932c-2143-4699-baaf-cc65b5552c15", "address": "fa:16:3e:27:12:cc", "network": {"id": "a2536574-aea2-4d48-a3d5-65b37e440206", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1465242308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43902590da14baa9aa3dd80ad8ff4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0f932c-21", "ovs_interfaceid": "7e0f932c-2143-4699-baaf-cc65b5552c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Releasing lock "refresh_cache-43f11322-00e7-472d-91f9-48ac1b16f33c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Instance network_info: |[{"id": "7e0f932c-2143-4699-baaf-cc65b5552c15", "address": "fa:16:3e:27:12:cc", "network": {"id": "a2536574-aea2-4d48-a3d5-65b37e440206", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1465242308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43902590da14baa9aa3dd80ad8ff4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0f932c-21", "ovs_interfaceid": "7e0f932c-2143-4699-baaf-cc65b5552c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Start _get_guest_xml network_info=[{"id": "7e0f932c-2143-4699-baaf-cc65b5552c15", "address": "fa:16:3e:27:12:cc", "network": {"id": "a2536574-aea2-4d48-a3d5-65b37e440206", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1465242308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43902590da14baa9aa3dd80ad8ff4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0f932c-21", "ovs_interfaceid": "7e0f932c-2143-4699-baaf-cc65b5552c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:47:52Z,direct_url=<?>,disk_format='qcow2',id=c731691c-b724-44ba-ae7f-945af1ab2bd0,min_disk=0,min_ram=0,name='',owner='05ea19f838bd4ad9a136a246dcca12d0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:47:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/sda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': 'c731691c-b724-44ba-ae7f-945af1ab2bd0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:48:07 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:07 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:47:52Z,direct_url=<?>,disk_format='qcow2',id=c731691c-b724-44ba-ae7f-945af1ab2bd0,min_disk=0,min_ram=0,name='',owner='05ea19f838bd4ad9a136a246dcca12d0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:47:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-971722182',display_name='tempest-AttachSCSIVolumeTestJSON-server-971722182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-971722182',id=6,image_ref='c731691c-b724-44ba-ae7f-945af1ab2bd0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyD1U+js/KIE/tzP+Id3Ue70ofRTOmqUTcvS9LLNzFAEbGR7zEGcjMin33pFJHrK5oBkq2Xo7Q6gJy27Zw/THeeXl8zN8ZSghnIRPECgXusoTwSdQIIIJEq+H/6pOAg7A==',key_name='tempest-keypair-1940531588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f43902590da14baa9aa3dd80ad8ff4dc',ramdisk_id='',reservation_id='r-ekpex3r3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c731691c-b724-44ba-ae7f-945af1ab2bd0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-128383334',owner_user_name='tempest-AttachSCSIVolumeTestJSON-128383334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:48:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab1d5b225c31426d8b63983387245c17',uuid=43f11322-00e7-472d-91f9-48ac1b16f33c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e0f932c-2143-4699-baaf-cc65b5552c15", "address": "fa:16:3e:27:12:cc", "network": {"id": "a2536574-aea2-4d48-a3d5-65b37e440206", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1465242308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43902590da14baa9aa3dd80ad8ff4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0f932c-21", "ovs_interfaceid": "7e0f932c-2143-4699-baaf-cc65b5552c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Converting VIF {"id": "7e0f932c-2143-4699-baaf-cc65b5552c15", "address": "fa:16:3e:27:12:cc", "network": {"id": "a2536574-aea2-4d48-a3d5-65b37e440206", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1465242308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43902590da14baa9aa3dd80ad8ff4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0f932c-21", "ovs_interfaceid": "7e0f932c-2143-4699-baaf-cc65b5552c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:12:cc,bridge_name='br-int',has_traffic_filtering=True,id=7e0f932c-2143-4699-baaf-cc65b5552c15,network=Network(a2536574-aea2-4d48-a3d5-65b37e440206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0f932c-21') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.objects.instance [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lazy-loading 'pci_devices' on Instance uuid 43f11322-00e7-472d-91f9-48ac1b16f33c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Received event network-vif-plugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] No waiting events found dispatching network-vif-plugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:07 user nova-compute[75813]: WARNING nova.compute.manager [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Received unexpected event network-vif-plugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 for instance with vm_state building and task_state spawning.
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Received event network-changed-7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Refreshing instance network info cache due to event network-changed-7e0f932c-2143-4699-baaf-cc65b5552c15. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] Acquiring lock "refresh_cache-43f11322-00e7-472d-91f9-48ac1b16f33c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] Acquired lock "refresh_cache-43f11322-00e7-472d-91f9-48ac1b16f33c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.network.neutron [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Refreshing network info cache for port 7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:48:07 user nova-compute[75813]:   <uuid>43f11322-00e7-472d-91f9-48ac1b16f33c</uuid>
Nov 15 12:48:07 user nova-compute[75813]:   <name>instance-00000006</name>
Nov 15 12:48:07 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:48:07 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:48:07 user nova-compute[75813]:   <metadata>
Nov 15 12:48:07 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:48:07 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:48:07 user nova-compute[75813]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-971722182</nova:name>
Nov 15 12:48:07 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:48:07</nova:creationTime>
Nov 15 12:48:07 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:48:07 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:48:07 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:48:07 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:48:07 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:48:07 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:48:07 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:48:07 user nova-compute[75813]:       <nova:owner>
Nov 15 12:48:07 user nova-compute[75813]:         <nova:user uuid="ab1d5b225c31426d8b63983387245c17">tempest-AttachSCSIVolumeTestJSON-128383334-project-member</nova:user>
Nov 15 12:48:07 user nova-compute[75813]:         <nova:project uuid="f43902590da14baa9aa3dd80ad8ff4dc">tempest-AttachSCSIVolumeTestJSON-128383334</nova:project>
Nov 15 12:48:07 user nova-compute[75813]:       </nova:owner>
Nov 15 12:48:07 user nova-compute[75813]:       <nova:root type="image" uuid="c731691c-b724-44ba-ae7f-945af1ab2bd0"/>
Nov 15 12:48:07 user nova-compute[75813]:       <nova:ports>
Nov 15 12:48:07 user nova-compute[75813]:         <nova:port uuid="7e0f932c-2143-4699-baaf-cc65b5552c15">
Nov 15 12:48:07 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 12:48:07 user nova-compute[75813]:         </nova:port>
Nov 15 12:48:07 user nova-compute[75813]:       </nova:ports>
Nov 15 12:48:07 user nova-compute[75813]:     </nova:instance>
Nov 15 12:48:07 user nova-compute[75813]:   </metadata>
Nov 15 12:48:07 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:48:07 user nova-compute[75813]:     <system>
Nov 15 12:48:07 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:48:07 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:48:07 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:48:07 user nova-compute[75813]:       <entry name="serial">43f11322-00e7-472d-91f9-48ac1b16f33c</entry>
Nov 15 12:48:07 user nova-compute[75813]:       <entry name="uuid">43f11322-00e7-472d-91f9-48ac1b16f33c</entry>
Nov 15 12:48:07 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:48:07 user nova-compute[75813]:     </system>
Nov 15 12:48:07 user nova-compute[75813]:   </sysinfo>
Nov 15 12:48:07 user nova-compute[75813]:   <os>
Nov 15 12:48:07 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:48:07 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:48:07 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:48:07 user nova-compute[75813]:   </os>
Nov 15 12:48:07 user nova-compute[75813]:   <features>
Nov 15 12:48:07 user nova-compute[75813]:     <acpi/>
Nov 15 12:48:07 user nova-compute[75813]:     <apic/>
Nov 15 12:48:07 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:48:07 user nova-compute[75813]:   </features>
Nov 15 12:48:07 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:48:07 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:48:07 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:48:07 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:48:07 user nova-compute[75813]:   </clock>
Nov 15 12:48:07 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:48:07 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:48:07 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:48:07 user nova-compute[75813]:   </cpu>
Nov 15 12:48:07 user nova-compute[75813]:   <devices>
Nov 15 12:48:07 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:48:07 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:48:07 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk"/>
Nov 15 12:48:07 user nova-compute[75813]:       <target dev="sda" bus="scsi"/>
Nov 15 12:48:07 user nova-compute[75813]:       <address type="drive" controller="0" unit="0"/>
Nov 15 12:48:07 user nova-compute[75813]:     </disk>
Nov 15 12:48:07 user nova-compute[75813]:     <disk type="file" device="cdrom">
Nov 15 12:48:07 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 12:48:07 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk.config"/>
Nov 15 12:48:07 user nova-compute[75813]:       <target dev="sdb" bus="scsi"/>
Nov 15 12:48:07 user nova-compute[75813]:       <address type="drive" controller="0" unit="1"/>
Nov 15 12:48:07 user nova-compute[75813]:     </disk>
Nov 15 12:48:07 user nova-compute[75813]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 12:48:07 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:48:07 user nova-compute[75813]:       <mac address="fa:16:3e:27:12:cc"/>
Nov 15 12:48:07 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:48:07 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:48:07 user nova-compute[75813]:       <target dev="tap7e0f932c-21"/>
Nov 15 12:48:07 user nova-compute[75813]:     </interface>
Nov 15 12:48:07 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:48:07 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/console.log" append="off"/>
Nov 15 12:48:07 user nova-compute[75813]:     </serial>
Nov 15 12:48:07 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:48:07 user nova-compute[75813]:     <video>
Nov 15 12:48:07 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:48:07 user nova-compute[75813]:     </video>
Nov 15 12:48:07 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:48:07 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:48:07 user nova-compute[75813]:     </rng>
Nov 15 12:48:07 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:48:07 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:48:07 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:48:07 user nova-compute[75813]:     </memballoon>
Nov 15 12:48:07 user nova-compute[75813]:   </devices>
Nov 15 12:48:07 user nova-compute[75813]: </domain>
Nov 15 12:48:07 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-971722182',display_name='tempest-AttachSCSIVolumeTestJSON-server-971722182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-971722182',id=6,image_ref='c731691c-b724-44ba-ae7f-945af1ab2bd0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyD1U+js/KIE/tzP+Id3Ue70ofRTOmqUTcvS9LLNzFAEbGR7zEGcjMin33pFJHrK5oBkq2Xo7Q6gJy27Zw/THeeXl8zN8ZSghnIRPECgXusoTwSdQIIIJEq+H/6pOAg7A==',key_name='tempest-keypair-1940531588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f43902590da14baa9aa3dd80ad8ff4dc',ramdisk_id='',reservation_id='r-ekpex3r3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c731691c-b724-44ba-ae7f-945af1ab2bd0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-128383334',owner_user_name='tempest-AttachSCSIVolumeTestJSON-128383334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:48:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab1d5b225c31426d8b63983387245c17',uuid=43f11322-00e7-472d-91f9-48ac1b16f33c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e0f932c-2143-4699-baaf-cc65b5552c15", "address": "fa:16:3e:27:12:cc", "network": {"id": "a2536574-aea2-4d48-a3d5-65b37e440206", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1465242308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43902590da14baa9aa3dd80ad8ff4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0f932c-21", "ovs_interfaceid": "7e0f932c-2143-4699-baaf-cc65b5552c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Converting VIF {"id": "7e0f932c-2143-4699-baaf-cc65b5552c15", "address": "fa:16:3e:27:12:cc", "network": {"id": "a2536574-aea2-4d48-a3d5-65b37e440206", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1465242308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43902590da14baa9aa3dd80ad8ff4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0f932c-21", "ovs_interfaceid": "7e0f932c-2143-4699-baaf-cc65b5552c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:12:cc,bridge_name='br-int',has_traffic_filtering=True,id=7e0f932c-2143-4699-baaf-cc65b5552c15,network=Network(a2536574-aea2-4d48-a3d5-65b37e440206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0f932c-21') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG os_vif [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:12:cc,bridge_name='br-int',has_traffic_filtering=True,id=7e0f932c-2143-4699-baaf-cc65b5552c15,network=Network(a2536574-aea2-4d48-a3d5-65b37e440206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0f932c-21') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '135ffc2c-340b-586a-959f-07215d842946', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e0f932c-21, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e0f932c-21, col_values=(('qos', UUID('93def695-7fe6-43e4-bc6d-3e07c14d87a2')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e0f932c-21, col_values=(('external_ids', {'iface-id': '7e0f932c-2143-4699-baaf-cc65b5552c15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:12:cc', 'vm-uuid': '43f11322-00e7-472d-91f9-48ac1b16f33c'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:07 user nova-compute[75813]: INFO os_vif [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:12:cc,bridge_name='br-int',has_traffic_filtering=True,id=7e0f932c-2143-4699-baaf-cc65b5552c15,network=Network(a2536574-aea2-4d48-a3d5-65b37e440206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0f932c-21')
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] No BDM found with device name sda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] No VIF found with MAC fa:16:3e:27:12:cc, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:48:07 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Using config drive
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:48:07 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Instance spawned successfully.
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.916s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:48:07 user nova-compute[75813]: INFO nova.compute.manager [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Took 8.71 seconds to spawn the instance on the hypervisor.
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:48:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:48:08 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:48:08 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:48:08 user nova-compute[75813]: INFO nova.compute.manager [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Took 9.95 seconds to build instance.
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-615d99f0-56b4-4ab2-a57d-cfaacfa7c010 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.087s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG nova.network.neutron [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Updated VIF entry in instance network info cache for port 7e0f932c-2143-4699-baaf-cc65b5552c15. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG nova.network.neutron [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Updating instance_info_cache with network_info: [{"id": "7e0f932c-2143-4699-baaf-cc65b5552c15", "address": "fa:16:3e:27:12:cc", "network": {"id": "a2536574-aea2-4d48-a3d5-65b37e440206", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1465242308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43902590da14baa9aa3dd80ad8ff4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0f932c-21", "ovs_interfaceid": "7e0f932c-2143-4699-baaf-cc65b5552c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ecfaac7-ef8b-4ef2-bc04-f8cba22cf358 req-18041b20-1282-4ce3-86f5-ef751fa839c7 service nova] Releasing lock "refresh_cache-43f11322-00e7-472d-91f9-48ac1b16f33c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG nova.policy [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6f1bfd1c5004266b76332081d0a5a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87366b2817cb490484846f30d737bcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:48:08 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Creating config drive at /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk.config
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3s95_tzg {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:48:08 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Creating image(s)
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "/opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "/opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3s95_tzg" returned: 0 in 0.114s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.235s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.238s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk 1073741824" returned: 0 in 0.116s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Successfully created port: 2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.296s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Cannot resize image /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Ensure instance console log exists: /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Successfully updated port: 2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Acquiring lock "refresh_cache-0e47f02a-040d-422f-8847-40eb19df4073" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Acquired lock "refresh_cache-0e47f02a-040d-422f-8847-40eb19df4073" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-bd01c3dd-5cd0-4886-921f-482dbb3fff25 req-12c16a1b-50fc-4a39-a09c-711d3cb6bbf8 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Received event network-changed-2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-bd01c3dd-5cd0-4886-921f-482dbb3fff25 req-12c16a1b-50fc-4a39-a09c-711d3cb6bbf8 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Refreshing instance network info cache due to event network-changed-2b17c39b-e529-4861-862a-a18d792319eb. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bd01c3dd-5cd0-4886-921f-482dbb3fff25 req-12c16a1b-50fc-4a39-a09c-711d3cb6bbf8 service nova] Acquiring lock "refresh_cache-0e47f02a-040d-422f-8847-40eb19df4073" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-3df86391-a700-44af-b164-a8592efc1698 req-304151d6-9745-4c08-bfc1-785c3bb0a732 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Received event network-vif-plugged-7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3df86391-a700-44af-b164-a8592efc1698 req-304151d6-9745-4c08-bfc1-785c3bb0a732 service nova] Acquiring lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3df86391-a700-44af-b164-a8592efc1698 req-304151d6-9745-4c08-bfc1-785c3bb0a732 service nova] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3df86391-a700-44af-b164-a8592efc1698 req-304151d6-9745-4c08-bfc1-785c3bb0a732 service nova] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-3df86391-a700-44af-b164-a8592efc1698 req-304151d6-9745-4c08-bfc1-785c3bb0a732 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] No waiting events found dispatching network-vif-plugged-7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:10 user nova-compute[75813]: WARNING nova.compute.manager [req-3df86391-a700-44af-b164-a8592efc1698 req-304151d6-9745-4c08-bfc1-785c3bb0a732 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Received unexpected event network-vif-plugged-7e0f932c-2143-4699-baaf-cc65b5552c15 for instance with vm_state building and task_state spawning.
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Updating instance_info_cache with network_info: [{"id": "2b17c39b-e529-4861-862a-a18d792319eb", "address": "fa:16:3e:47:ff:47", "network": {"id": "21c21876-9fad-43b9-aabf-195b5bcb7a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-507934887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87366b2817cb490484846f30d737bcba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b17c39b-e5", "ovs_interfaceid": "2b17c39b-e529-4861-862a-a18d792319eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Releasing lock "refresh_cache-0e47f02a-040d-422f-8847-40eb19df4073" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Instance network_info: |[{"id": "2b17c39b-e529-4861-862a-a18d792319eb", "address": "fa:16:3e:47:ff:47", "network": {"id": "21c21876-9fad-43b9-aabf-195b5bcb7a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-507934887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87366b2817cb490484846f30d737bcba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b17c39b-e5", "ovs_interfaceid": "2b17c39b-e529-4861-862a-a18d792319eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bd01c3dd-5cd0-4886-921f-482dbb3fff25 req-12c16a1b-50fc-4a39-a09c-711d3cb6bbf8 service nova] Acquired lock "refresh_cache-0e47f02a-040d-422f-8847-40eb19df4073" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.network.neutron [req-bd01c3dd-5cd0-4886-921f-482dbb3fff25 req-12c16a1b-50fc-4a39-a09c-711d3cb6bbf8 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Refreshing network info cache for port 2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Start _get_guest_xml network_info=[{"id": "2b17c39b-e529-4861-862a-a18d792319eb", "address": "fa:16:3e:47:ff:47", "network": {"id": "21c21876-9fad-43b9-aabf-195b5bcb7a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-507934887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87366b2817cb490484846f30d737bcba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b17c39b-e5", "ovs_interfaceid": "2b17c39b-e529-4861-862a-a18d792319eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:48:11 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:11 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1445511914',display_name='tempest-VolumesAssistedSnapshotsTest-server-1445511914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1445511914',id=7,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKVAJYEacrba1qyFzavdO/BUgbJuniKpQN3LPL4/NITuDxiTXvPajUlptDMQylVq/8mPkCFAt6mCPRWRLxgGbih18T062TBSOlGJXkc9jgSGsV8bdjCBlyI8NLriocKUA==',key_name='tempest-keypair-1040105164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87366b2817cb490484846f30d737bcba',ramdisk_id='',reservation_id='r-7gi9b9z5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1432371107',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1432371107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6f1bfd1c5004266b76332081d0a5a05',uuid=0e47f02a-040d-422f-8847-40eb19df4073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b17c39b-e529-4861-862a-a18d792319eb", "address": "fa:16:3e:47:ff:47", "network": {"id": "21c21876-9fad-43b9-aabf-195b5bcb7a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-507934887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87366b2817cb490484846f30d737bcba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b17c39b-e5", "ovs_interfaceid": "2b17c39b-e529-4861-862a-a18d792319eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Converting VIF {"id": "2b17c39b-e529-4861-862a-a18d792319eb", "address": "fa:16:3e:47:ff:47", "network": {"id": "21c21876-9fad-43b9-aabf-195b5bcb7a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-507934887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87366b2817cb490484846f30d737bcba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b17c39b-e5", "ovs_interfaceid": "2b17c39b-e529-4861-862a-a18d792319eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:ff:47,bridge_name='br-int',has_traffic_filtering=True,id=2b17c39b-e529-4861-862a-a18d792319eb,network=Network(21c21876-9fad-43b9-aabf-195b5bcb7a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b17c39b-e5') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.objects.instance [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e47f02a-040d-422f-8847-40eb19df4073 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:48:11 user nova-compute[75813]:   <uuid>0e47f02a-040d-422f-8847-40eb19df4073</uuid>
Nov 15 12:48:11 user nova-compute[75813]:   <name>instance-00000007</name>
Nov 15 12:48:11 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:48:11 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:48:11 user nova-compute[75813]:   <metadata>
Nov 15 12:48:11 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:48:11 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:48:11 user nova-compute[75813]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1445511914</nova:name>
Nov 15 12:48:11 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:48:11</nova:creationTime>
Nov 15 12:48:11 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:48:11 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:48:11 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:48:11 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:48:11 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:48:11 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:48:11 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:48:11 user nova-compute[75813]:       <nova:owner>
Nov 15 12:48:11 user nova-compute[75813]:         <nova:user uuid="a6f1bfd1c5004266b76332081d0a5a05">tempest-VolumesAssistedSnapshotsTest-1432371107-project-member</nova:user>
Nov 15 12:48:11 user nova-compute[75813]:         <nova:project uuid="87366b2817cb490484846f30d737bcba">tempest-VolumesAssistedSnapshotsTest-1432371107</nova:project>
Nov 15 12:48:11 user nova-compute[75813]:       </nova:owner>
Nov 15 12:48:11 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:48:11 user nova-compute[75813]:       <nova:ports>
Nov 15 12:48:11 user nova-compute[75813]:         <nova:port uuid="2b17c39b-e529-4861-862a-a18d792319eb">
Nov 15 12:48:11 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 12:48:11 user nova-compute[75813]:         </nova:port>
Nov 15 12:48:11 user nova-compute[75813]:       </nova:ports>
Nov 15 12:48:11 user nova-compute[75813]:     </nova:instance>
Nov 15 12:48:11 user nova-compute[75813]:   </metadata>
Nov 15 12:48:11 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:48:11 user nova-compute[75813]:     <system>
Nov 15 12:48:11 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:48:11 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:48:11 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:48:11 user nova-compute[75813]:       <entry name="serial">0e47f02a-040d-422f-8847-40eb19df4073</entry>
Nov 15 12:48:11 user nova-compute[75813]:       <entry name="uuid">0e47f02a-040d-422f-8847-40eb19df4073</entry>
Nov 15 12:48:11 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:48:11 user nova-compute[75813]:     </system>
Nov 15 12:48:11 user nova-compute[75813]:   </sysinfo>
Nov 15 12:48:11 user nova-compute[75813]:   <os>
Nov 15 12:48:11 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:48:11 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:48:11 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:48:11 user nova-compute[75813]:   </os>
Nov 15 12:48:11 user nova-compute[75813]:   <features>
Nov 15 12:48:11 user nova-compute[75813]:     <acpi/>
Nov 15 12:48:11 user nova-compute[75813]:     <apic/>
Nov 15 12:48:11 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:48:11 user nova-compute[75813]:   </features>
Nov 15 12:48:11 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:48:11 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:48:11 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:48:11 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:48:11 user nova-compute[75813]:   </clock>
Nov 15 12:48:11 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:48:11 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:48:11 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:48:11 user nova-compute[75813]:   </cpu>
Nov 15 12:48:11 user nova-compute[75813]:   <devices>
Nov 15 12:48:11 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:48:11 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:48:11 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk"/>
Nov 15 12:48:11 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:48:11 user nova-compute[75813]:     </disk>
Nov 15 12:48:11 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:48:11 user nova-compute[75813]:       <mac address="fa:16:3e:47:ff:47"/>
Nov 15 12:48:11 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:48:11 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:48:11 user nova-compute[75813]:       <target dev="tap2b17c39b-e5"/>
Nov 15 12:48:11 user nova-compute[75813]:     </interface>
Nov 15 12:48:11 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:48:11 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/console.log" append="off"/>
Nov 15 12:48:11 user nova-compute[75813]:     </serial>
Nov 15 12:48:11 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:48:11 user nova-compute[75813]:     <video>
Nov 15 12:48:11 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:48:11 user nova-compute[75813]:     </video>
Nov 15 12:48:11 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:48:11 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:48:11 user nova-compute[75813]:     </rng>
Nov 15 12:48:11 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:48:11 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:48:11 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:48:11 user nova-compute[75813]:     </memballoon>
Nov 15 12:48:11 user nova-compute[75813]:   </devices>
Nov 15 12:48:11 user nova-compute[75813]: </domain>
Nov 15 12:48:11 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1445511914',display_name='tempest-VolumesAssistedSnapshotsTest-server-1445511914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1445511914',id=7,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKVAJYEacrba1qyFzavdO/BUgbJuniKpQN3LPL4/NITuDxiTXvPajUlptDMQylVq/8mPkCFAt6mCPRWRLxgGbih18T062TBSOlGJXkc9jgSGsV8bdjCBlyI8NLriocKUA==',key_name='tempest-keypair-1040105164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87366b2817cb490484846f30d737bcba',ramdisk_id='',reservation_id='r-7gi9b9z5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1432371107',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1432371107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6f1bfd1c5004266b76332081d0a5a05',uuid=0e47f02a-040d-422f-8847-40eb19df4073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b17c39b-e529-4861-862a-a18d792319eb", "address": "fa:16:3e:47:ff:47", "network": {"id": "21c21876-9fad-43b9-aabf-195b5bcb7a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-507934887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87366b2817cb490484846f30d737bcba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b17c39b-e5", "ovs_interfaceid": "2b17c39b-e529-4861-862a-a18d792319eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Converting VIF {"id": "2b17c39b-e529-4861-862a-a18d792319eb", "address": "fa:16:3e:47:ff:47", "network": {"id": "21c21876-9fad-43b9-aabf-195b5bcb7a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-507934887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87366b2817cb490484846f30d737bcba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b17c39b-e5", "ovs_interfaceid": "2b17c39b-e529-4861-862a-a18d792319eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:ff:47,bridge_name='br-int',has_traffic_filtering=True,id=2b17c39b-e529-4861-862a-a18d792319eb,network=Network(21c21876-9fad-43b9-aabf-195b5bcb7a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b17c39b-e5') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG os_vif [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:ff:47,bridge_name='br-int',has_traffic_filtering=True,id=2b17c39b-e529-4861-862a-a18d792319eb,network=Network(21c21876-9fad-43b9-aabf-195b5bcb7a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b17c39b-e5') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cf9c850-387a-5baa-882a-d8eb3df98d71', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b17c39b-e5, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b17c39b-e5, col_values=(('qos', UUID('d851464a-6306-4ae3-8da5-c3b2bed3c21f')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b17c39b-e5, col_values=(('external_ids', {'iface-id': '2b17c39b-e529-4861-862a-a18d792319eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:ff:47', 'vm-uuid': '0e47f02a-040d-422f-8847-40eb19df4073'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:11 user nova-compute[75813]: INFO os_vif [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:ff:47,bridge_name='br-int',has_traffic_filtering=True,id=2b17c39b-e529-4861-862a-a18d792319eb,network=Network(21c21876-9fad-43b9-aabf-195b5bcb7a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b17c39b-e5')
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] No VIF found with MAC fa:16:3e:47:ff:47, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.network.neutron [req-bd01c3dd-5cd0-4886-921f-482dbb3fff25 req-12c16a1b-50fc-4a39-a09c-711d3cb6bbf8 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Updated VIF entry in instance network info cache for port 2b17c39b-e529-4861-862a-a18d792319eb. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG nova.network.neutron [req-bd01c3dd-5cd0-4886-921f-482dbb3fff25 req-12c16a1b-50fc-4a39-a09c-711d3cb6bbf8 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Updating instance_info_cache with network_info: [{"id": "2b17c39b-e529-4861-862a-a18d792319eb", "address": "fa:16:3e:47:ff:47", "network": {"id": "21c21876-9fad-43b9-aabf-195b5bcb7a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-507934887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87366b2817cb490484846f30d737bcba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b17c39b-e5", "ovs_interfaceid": "2b17c39b-e529-4861-862a-a18d792319eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:48:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bd01c3dd-5cd0-4886-921f-482dbb3fff25 req-12c16a1b-50fc-4a39-a09c-711d3cb6bbf8 service nova] Releasing lock "refresh_cache-0e47f02a-040d-422f-8847-40eb19df4073" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:48:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-f97d3992-ca3b-4deb-8529-e568e22016f1 req-6a757d25-da79-4025-a3ac-df420362c13b service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Received event network-vif-plugged-7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f97d3992-ca3b-4deb-8529-e568e22016f1 req-6a757d25-da79-4025-a3ac-df420362c13b service nova] Acquiring lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f97d3992-ca3b-4deb-8529-e568e22016f1 req-6a757d25-da79-4025-a3ac-df420362c13b service nova] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f97d3992-ca3b-4deb-8529-e568e22016f1 req-6a757d25-da79-4025-a3ac-df420362c13b service nova] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-f97d3992-ca3b-4deb-8529-e568e22016f1 req-6a757d25-da79-4025-a3ac-df420362c13b service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] No waiting events found dispatching network-vif-plugged-7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:12 user nova-compute[75813]: WARNING nova.compute.manager [req-f97d3992-ca3b-4deb-8529-e568e22016f1 req-6a757d25-da79-4025-a3ac-df420362c13b service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Received unexpected event network-vif-plugged-7e0f932c-2143-4699-baaf-cc65b5552c15 for instance with vm_state building and task_state spawning.
Nov 15 12:48:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:13 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Instance spawned successfully.
Nov 15 12:48:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:13 user nova-compute[75813]: INFO nova.compute.manager [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Took 9.44 seconds to spawn the instance on the hypervisor.
Nov 15 12:48:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:48:13 user nova-compute[75813]: INFO nova.compute.manager [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Took 10.91 seconds to build instance.
Nov 15 12:48:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-9baed7d3-8df3-4d25-9e8a-e0455da8eb77 req-13aaa84f-bc29-422d-ad4c-a2d575bf37b8 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Received event network-vif-plugged-2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9baed7d3-8df3-4d25-9e8a-e0455da8eb77 req-13aaa84f-bc29-422d-ad4c-a2d575bf37b8 service nova] Acquiring lock "0e47f02a-040d-422f-8847-40eb19df4073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9baed7d3-8df3-4d25-9e8a-e0455da8eb77 req-13aaa84f-bc29-422d-ad4c-a2d575bf37b8 service nova] Lock "0e47f02a-040d-422f-8847-40eb19df4073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9baed7d3-8df3-4d25-9e8a-e0455da8eb77 req-13aaa84f-bc29-422d-ad4c-a2d575bf37b8 service nova] Lock "0e47f02a-040d-422f-8847-40eb19df4073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-9baed7d3-8df3-4d25-9e8a-e0455da8eb77 req-13aaa84f-bc29-422d-ad4c-a2d575bf37b8 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] No waiting events found dispatching network-vif-plugged-2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:13 user nova-compute[75813]: WARNING nova.compute.manager [req-9baed7d3-8df3-4d25-9e8a-e0455da8eb77 req-13aaa84f-bc29-422d-ad4c-a2d575bf37b8 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Received unexpected event network-vif-plugged-2b17c39b-e529-4861-862a-a18d792319eb for instance with vm_state building and task_state spawning.
Nov 15 12:48:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b48c5cf-6670-4ba0-98ae-37c0b0307354 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.194s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:48:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Instance spawned successfully.
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-677a5893-813d-4799-9f38-4cfb2d4d0c86 req-6c308a84-5693-4195-a755-e7ffb2153432 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Received event network-vif-plugged-2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-677a5893-813d-4799-9f38-4cfb2d4d0c86 req-6c308a84-5693-4195-a755-e7ffb2153432 service nova] Acquiring lock "0e47f02a-040d-422f-8847-40eb19df4073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-677a5893-813d-4799-9f38-4cfb2d4d0c86 req-6c308a84-5693-4195-a755-e7ffb2153432 service nova] Lock "0e47f02a-040d-422f-8847-40eb19df4073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-677a5893-813d-4799-9f38-4cfb2d4d0c86 req-6c308a84-5693-4195-a755-e7ffb2153432 service nova] Lock "0e47f02a-040d-422f-8847-40eb19df4073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-677a5893-813d-4799-9f38-4cfb2d4d0c86 req-6c308a84-5693-4195-a755-e7ffb2153432 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] No waiting events found dispatching network-vif-plugged-2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:15 user nova-compute[75813]: WARNING nova.compute.manager [req-677a5893-813d-4799-9f38-4cfb2d4d0c86 req-6c308a84-5693-4195-a755-e7ffb2153432 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Received unexpected event network-vif-plugged-2b17c39b-e529-4861-862a-a18d792319eb for instance with vm_state building and task_state spawning.
Nov 15 12:48:15 user nova-compute[75813]: INFO nova.compute.manager [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 15 12:48:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:48:16 user nova-compute[75813]: INFO nova.compute.manager [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Took 9.10 seconds to build instance.
Nov 15 12:48:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b2c18c2d-bce7-4225-8c02-3cb964957a6d tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "0e47f02a-040d-422f-8847-40eb19df4073" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.292s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Acquiring lock "3d4122cd-dafe-4dd0-b7e6-38125513807f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:48:25 user nova-compute[75813]: INFO nova.compute.claims [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Claim successful on node user
Nov 15 12:48:25 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:48:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:48:25 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG nova.policy [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cc425e9972b476ead35f79802893b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a0a98f55d4dac988168491dda9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:48:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Creating image(s)
Nov 15 12:48:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "/opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "/opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Successfully created port: 106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk 1073741824" returned: 0 in 0.057s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Cannot resize image /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Ensure instance console log exists: /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:27 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Successfully updated port: 106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:48:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Acquiring lock "refresh_cache-3d4122cd-dafe-4dd0-b7e6-38125513807f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:48:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Acquired lock "refresh_cache-3d4122cd-dafe-4dd0-b7e6-38125513807f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:48:27 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:48:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-85df353c-53d7-4c50-b271-0d4579db66bd req-3591cf32-1270-4936-80f7-7449a6598a8a service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Received event network-changed-106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-85df353c-53d7-4c50-b271-0d4579db66bd req-3591cf32-1270-4936-80f7-7449a6598a8a service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Refreshing instance network info cache due to event network-changed-106d6039-b2e2-457e-9a5a-745dde3e597a. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:48:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-85df353c-53d7-4c50-b271-0d4579db66bd req-3591cf32-1270-4936-80f7-7449a6598a8a service nova] Acquiring lock "refresh_cache-3d4122cd-dafe-4dd0-b7e6-38125513807f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:48:27 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Updating instance_info_cache with network_info: [{"id": "106d6039-b2e2-457e-9a5a-745dde3e597a", "address": "fa:16:3e:bd:fd:88", "network": {"id": "18a5847d-f657-4757-a18b-d654ec9617ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-802389147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "803a0a98f55d4dac988168491dda9c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106d6039-b2", "ovs_interfaceid": "106d6039-b2e2-457e-9a5a-745dde3e597a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Releasing lock "refresh_cache-3d4122cd-dafe-4dd0-b7e6-38125513807f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Instance network_info: |[{"id": "106d6039-b2e2-457e-9a5a-745dde3e597a", "address": "fa:16:3e:bd:fd:88", "network": {"id": "18a5847d-f657-4757-a18b-d654ec9617ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-802389147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "803a0a98f55d4dac988168491dda9c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106d6039-b2", "ovs_interfaceid": "106d6039-b2e2-457e-9a5a-745dde3e597a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-85df353c-53d7-4c50-b271-0d4579db66bd req-3591cf32-1270-4936-80f7-7449a6598a8a service nova] Acquired lock "refresh_cache-3d4122cd-dafe-4dd0-b7e6-38125513807f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.network.neutron [req-85df353c-53d7-4c50-b271-0d4579db66bd req-3591cf32-1270-4936-80f7-7449a6598a8a service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Refreshing network info cache for port 106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Start _get_guest_xml network_info=[{"id": "106d6039-b2e2-457e-9a5a-745dde3e597a", "address": "fa:16:3e:bd:fd:88", "network": {"id": "18a5847d-f657-4757-a18b-d654ec9617ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-802389147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "803a0a98f55d4dac988168491dda9c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106d6039-b2", "ovs_interfaceid": "106d6039-b2e2-457e-9a5a-745dde3e597a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:48:28 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:28 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-154413265',display_name='tempest-VolumesActionsTest-instance-154413265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-154413265',id=8,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='803a0a98f55d4dac988168491dda9c29',ramdisk_id='',reservation_id='r-uy50wa2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-381635204',owner_user_name='tempest-VolumesActionsTest-381635204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:48:26Z,user_data=None,user_id='2cc425e9972b476ead35f79802893b17',uuid=3d4122cd-dafe-4dd0-b7e6-38125513807f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "106d6039-b2e2-457e-9a5a-745dde3e597a", "address": "fa:16:3e:bd:fd:88", "network": {"id": "18a5847d-f657-4757-a18b-d654ec9617ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-802389147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "803a0a98f55d4dac988168491dda9c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106d6039-b2", "ovs_interfaceid": "106d6039-b2e2-457e-9a5a-745dde3e597a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Converting VIF {"id": "106d6039-b2e2-457e-9a5a-745dde3e597a", "address": "fa:16:3e:bd:fd:88", "network": {"id": "18a5847d-f657-4757-a18b-d654ec9617ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-802389147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "803a0a98f55d4dac988168491dda9c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106d6039-b2", "ovs_interfaceid": "106d6039-b2e2-457e-9a5a-745dde3e597a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fd:88,bridge_name='br-int',has_traffic_filtering=True,id=106d6039-b2e2-457e-9a5a-745dde3e597a,network=Network(18a5847d-f657-4757-a18b-d654ec9617ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106d6039-b2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d4122cd-dafe-4dd0-b7e6-38125513807f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:48:28 user nova-compute[75813]:   <uuid>3d4122cd-dafe-4dd0-b7e6-38125513807f</uuid>
Nov 15 12:48:28 user nova-compute[75813]:   <name>instance-00000008</name>
Nov 15 12:48:28 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:48:28 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:48:28 user nova-compute[75813]:   <metadata>
Nov 15 12:48:28 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:48:28 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:48:28 user nova-compute[75813]:       <nova:name>tempest-VolumesActionsTest-instance-154413265</nova:name>
Nov 15 12:48:28 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:48:28</nova:creationTime>
Nov 15 12:48:28 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:48:28 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:48:28 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:48:28 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:48:28 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:48:28 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:48:28 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:48:28 user nova-compute[75813]:       <nova:owner>
Nov 15 12:48:28 user nova-compute[75813]:         <nova:user uuid="2cc425e9972b476ead35f79802893b17">tempest-VolumesActionsTest-381635204-project-member</nova:user>
Nov 15 12:48:28 user nova-compute[75813]:         <nova:project uuid="803a0a98f55d4dac988168491dda9c29">tempest-VolumesActionsTest-381635204</nova:project>
Nov 15 12:48:28 user nova-compute[75813]:       </nova:owner>
Nov 15 12:48:28 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:48:28 user nova-compute[75813]:       <nova:ports>
Nov 15 12:48:28 user nova-compute[75813]:         <nova:port uuid="106d6039-b2e2-457e-9a5a-745dde3e597a">
Nov 15 12:48:28 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 12:48:28 user nova-compute[75813]:         </nova:port>
Nov 15 12:48:28 user nova-compute[75813]:       </nova:ports>
Nov 15 12:48:28 user nova-compute[75813]:     </nova:instance>
Nov 15 12:48:28 user nova-compute[75813]:   </metadata>
Nov 15 12:48:28 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:48:28 user nova-compute[75813]:     <system>
Nov 15 12:48:28 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:48:28 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:48:28 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:48:28 user nova-compute[75813]:       <entry name="serial">3d4122cd-dafe-4dd0-b7e6-38125513807f</entry>
Nov 15 12:48:28 user nova-compute[75813]:       <entry name="uuid">3d4122cd-dafe-4dd0-b7e6-38125513807f</entry>
Nov 15 12:48:28 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:48:28 user nova-compute[75813]:     </system>
Nov 15 12:48:28 user nova-compute[75813]:   </sysinfo>
Nov 15 12:48:28 user nova-compute[75813]:   <os>
Nov 15 12:48:28 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:48:28 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:48:28 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:48:28 user nova-compute[75813]:   </os>
Nov 15 12:48:28 user nova-compute[75813]:   <features>
Nov 15 12:48:28 user nova-compute[75813]:     <acpi/>
Nov 15 12:48:28 user nova-compute[75813]:     <apic/>
Nov 15 12:48:28 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:48:28 user nova-compute[75813]:   </features>
Nov 15 12:48:28 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:48:28 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:48:28 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:48:28 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:48:28 user nova-compute[75813]:   </clock>
Nov 15 12:48:28 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:48:28 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:48:28 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:48:28 user nova-compute[75813]:   </cpu>
Nov 15 12:48:28 user nova-compute[75813]:   <devices>
Nov 15 12:48:28 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:48:28 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:48:28 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk"/>
Nov 15 12:48:28 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:48:28 user nova-compute[75813]:     </disk>
Nov 15 12:48:28 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:48:28 user nova-compute[75813]:       <mac address="fa:16:3e:bd:fd:88"/>
Nov 15 12:48:28 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:48:28 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:48:28 user nova-compute[75813]:       <target dev="tap106d6039-b2"/>
Nov 15 12:48:28 user nova-compute[75813]:     </interface>
Nov 15 12:48:28 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:48:28 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/console.log" append="off"/>
Nov 15 12:48:28 user nova-compute[75813]:     </serial>
Nov 15 12:48:28 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:48:28 user nova-compute[75813]:     <video>
Nov 15 12:48:28 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:48:28 user nova-compute[75813]:     </video>
Nov 15 12:48:28 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:48:28 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:48:28 user nova-compute[75813]:     </rng>
Nov 15 12:48:28 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:48:28 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:48:28 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:48:28 user nova-compute[75813]:     </memballoon>
Nov 15 12:48:28 user nova-compute[75813]:   </devices>
Nov 15 12:48:28 user nova-compute[75813]: </domain>
Nov 15 12:48:28 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-154413265',display_name='tempest-VolumesActionsTest-instance-154413265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-154413265',id=8,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='803a0a98f55d4dac988168491dda9c29',ramdisk_id='',reservation_id='r-uy50wa2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-381635204',owner_user_name='tempest-VolumesActionsTest-381635204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:48:26Z,user_data=None,user_id='2cc425e9972b476ead35f79802893b17',uuid=3d4122cd-dafe-4dd0-b7e6-38125513807f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "106d6039-b2e2-457e-9a5a-745dde3e597a", "address": "fa:16:3e:bd:fd:88", "network": {"id": "18a5847d-f657-4757-a18b-d654ec9617ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-802389147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "803a0a98f55d4dac988168491dda9c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106d6039-b2", "ovs_interfaceid": "106d6039-b2e2-457e-9a5a-745dde3e597a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Converting VIF {"id": "106d6039-b2e2-457e-9a5a-745dde3e597a", "address": "fa:16:3e:bd:fd:88", "network": {"id": "18a5847d-f657-4757-a18b-d654ec9617ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-802389147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "803a0a98f55d4dac988168491dda9c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106d6039-b2", "ovs_interfaceid": "106d6039-b2e2-457e-9a5a-745dde3e597a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fd:88,bridge_name='br-int',has_traffic_filtering=True,id=106d6039-b2e2-457e-9a5a-745dde3e597a,network=Network(18a5847d-f657-4757-a18b-d654ec9617ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106d6039-b2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG os_vif [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fd:88,bridge_name='br-int',has_traffic_filtering=True,id=106d6039-b2e2-457e-9a5a-745dde3e597a,network=Network(18a5847d-f657-4757-a18b-d654ec9617ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106d6039-b2') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '771c6764-675e-51c8-861c-d9a2ee8f766b', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap106d6039-b2, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap106d6039-b2, col_values=(('qos', UUID('121fa24e-5a97-4bf1-b16a-ba70d679b3d2')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap106d6039-b2, col_values=(('external_ids', {'iface-id': '106d6039-b2e2-457e-9a5a-745dde3e597a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:fd:88', 'vm-uuid': '3d4122cd-dafe-4dd0-b7e6-38125513807f'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:28 user nova-compute[75813]: INFO os_vif [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fd:88,bridge_name='br-int',has_traffic_filtering=True,id=106d6039-b2e2-457e-9a5a-745dde3e597a,network=Network(18a5847d-f657-4757-a18b-d654ec9617ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106d6039-b2')
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] No VIF found with MAC fa:16:3e:bd:fd:88, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.network.neutron [req-85df353c-53d7-4c50-b271-0d4579db66bd req-3591cf32-1270-4936-80f7-7449a6598a8a service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Updated VIF entry in instance network info cache for port 106d6039-b2e2-457e-9a5a-745dde3e597a. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG nova.network.neutron [req-85df353c-53d7-4c50-b271-0d4579db66bd req-3591cf32-1270-4936-80f7-7449a6598a8a service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Updating instance_info_cache with network_info: [{"id": "106d6039-b2e2-457e-9a5a-745dde3e597a", "address": "fa:16:3e:bd:fd:88", "network": {"id": "18a5847d-f657-4757-a18b-d654ec9617ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-802389147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "803a0a98f55d4dac988168491dda9c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106d6039-b2", "ovs_interfaceid": "106d6039-b2e2-457e-9a5a-745dde3e597a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:48:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-85df353c-53d7-4c50-b271-0d4579db66bd req-3591cf32-1270-4936-80f7-7449a6598a8a service nova] Releasing lock "refresh_cache-3d4122cd-dafe-4dd0-b7e6-38125513807f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:48:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:30 user nova-compute[75813]: DEBUG nova.compute.manager [req-8302c14c-bb65-494b-8346-44300f6911a3 req-acbab061-0b86-4e2c-b526-91e5df64ecec service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Received event network-vif-plugged-106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8302c14c-bb65-494b-8346-44300f6911a3 req-acbab061-0b86-4e2c-b526-91e5df64ecec service nova] Acquiring lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8302c14c-bb65-494b-8346-44300f6911a3 req-acbab061-0b86-4e2c-b526-91e5df64ecec service nova] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8302c14c-bb65-494b-8346-44300f6911a3 req-acbab061-0b86-4e2c-b526-91e5df64ecec service nova] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:30 user nova-compute[75813]: DEBUG nova.compute.manager [req-8302c14c-bb65-494b-8346-44300f6911a3 req-acbab061-0b86-4e2c-b526-91e5df64ecec service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] No waiting events found dispatching network-vif-plugged-106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:30 user nova-compute[75813]: WARNING nova.compute.manager [req-8302c14c-bb65-494b-8346-44300f6911a3 req-acbab061-0b86-4e2c-b526-91e5df64ecec service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Received unexpected event network-vif-plugged-106d6039-b2e2-457e-9a5a-745dde3e597a for instance with vm_state building and task_state spawning.
Nov 15 12:48:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 12:48:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] There are 0 instances to clean {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 12:48:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75813) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 12:48:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:48:32 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Instance spawned successfully.
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-cac1a9bc-9f33-41fa-b529-cdc8521b0202 req-e207a613-1d5e-4dc6-b00e-287de1e8e1f8 service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Received event network-vif-plugged-106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cac1a9bc-9f33-41fa-b529-cdc8521b0202 req-e207a613-1d5e-4dc6-b00e-287de1e8e1f8 service nova] Acquiring lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cac1a9bc-9f33-41fa-b529-cdc8521b0202 req-e207a613-1d5e-4dc6-b00e-287de1e8e1f8 service nova] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cac1a9bc-9f33-41fa-b529-cdc8521b0202 req-e207a613-1d5e-4dc6-b00e-287de1e8e1f8 service nova] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-cac1a9bc-9f33-41fa-b529-cdc8521b0202 req-e207a613-1d5e-4dc6-b00e-287de1e8e1f8 service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] No waiting events found dispatching network-vif-plugged-106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:32 user nova-compute[75813]: WARNING nova.compute.manager [req-cac1a9bc-9f33-41fa-b529-cdc8521b0202 req-e207a613-1d5e-4dc6-b00e-287de1e8e1f8 service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Received unexpected event network-vif-plugged-106d6039-b2e2-457e-9a5a-745dde3e597a for instance with vm_state building and task_state spawning.
Nov 15 12:48:32 user nova-compute[75813]: INFO nova.compute.manager [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 15 12:48:32 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:48:32 user nova-compute[75813]: INFO nova.compute.manager [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Took 7.21 seconds to build instance.
Nov 15 12:48:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c67bcd48-d786-4f48-9caa-420fad299338 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.522s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:39 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:39 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7537MB free_disk=25.447917938232422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 870cf760-ae0c-4df1-99cf-6403d8e642ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 36b32262-4ea0-4a33-9672-82c7b8061bb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ec571e3e-90e0-47d4-b1ae-98a356dc43f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 43f11322-00e7-472d-91f9-48ac1b16f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 0e47f02a-040d-422f-8847-40eb19df4073 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 3d4122cd-dafe-4dd0-b7e6-38125513807f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:48:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Acquiring lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:48:40 user nova-compute[75813]: INFO nova.compute.claims [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Claim successful on node user
Nov 15 12:48:40 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Refreshing inventories for resource provider 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Updating ProviderTree inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Refreshing aggregate associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, aggregates: None {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Refreshing trait associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, traits: HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:48:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Skipping network cache update for instance because it is Building. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:48:41 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid 870cf760-ae0c-4df1-99cf-6403d8e642ce {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:48:41 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Creating image(s)
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Acquiring lock "/opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "/opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "/opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.policy [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31e2016c3ddf462b82363f1ed707ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6313bfce446d1b2491e9bbbf11043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.209s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk 1073741824" returned: 0 in 0.065s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Updating instance_info_cache with network_info: [{"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.212s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:48:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:48:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:48:42 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Cannot resize image /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:48:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:48:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Ensure instance console log exists: /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:48:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Successfully created port: 0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Successfully updated port: 0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Acquiring lock "refresh_cache-8384fa60-36fd-4ad1-b397-8bc9ab088f01" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Acquired lock "refresh_cache-8384fa60-36fd-4ad1-b397-8bc9ab088f01" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-098f10ed-217a-46dc-aa3e-5a08870d7eb1 req-8e01347b-fa98-4e76-9efd-85a0811fbca7 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Received event network-changed-0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-098f10ed-217a-46dc-aa3e-5a08870d7eb1 req-8e01347b-fa98-4e76-9efd-85a0811fbca7 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Refreshing instance network info cache due to event network-changed-0e35e03f-9a71-4d0a-afe6-ec888446e45c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-098f10ed-217a-46dc-aa3e-5a08870d7eb1 req-8e01347b-fa98-4e76-9efd-85a0811fbca7 service nova] Acquiring lock "refresh_cache-8384fa60-36fd-4ad1-b397-8bc9ab088f01" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Updating instance_info_cache with network_info: [{"id": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "address": "fa:16:3e:0f:f4:63", "network": {"id": "9ccfe082-59ac-4f3e-b645-e7515227e74a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "496b19c3bbca416b90a414b3d4c03a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e35e03f-9a", "ovs_interfaceid": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Releasing lock "refresh_cache-8384fa60-36fd-4ad1-b397-8bc9ab088f01" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Instance network_info: |[{"id": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "address": "fa:16:3e:0f:f4:63", "network": {"id": "9ccfe082-59ac-4f3e-b645-e7515227e74a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "496b19c3bbca416b90a414b3d4c03a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e35e03f-9a", "ovs_interfaceid": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-098f10ed-217a-46dc-aa3e-5a08870d7eb1 req-8e01347b-fa98-4e76-9efd-85a0811fbca7 service nova] Acquired lock "refresh_cache-8384fa60-36fd-4ad1-b397-8bc9ab088f01" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-098f10ed-217a-46dc-aa3e-5a08870d7eb1 req-8e01347b-fa98-4e76-9efd-85a0811fbca7 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Refreshing network info cache for port 0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Start _get_guest_xml network_info=[{"id": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "address": "fa:16:3e:0f:f4:63", "network": {"id": "9ccfe082-59ac-4f3e-b645-e7515227e74a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "496b19c3bbca416b90a414b3d4c03a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e35e03f-9a", "ovs_interfaceid": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:48:43 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:43 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-103586113',display_name='tempest-VolumesNegativeTest-instance-103586113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-103586113',id=9,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6a6313bfce446d1b2491e9bbbf11043',ramdisk_id='',reservation_id='r-4o746nou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1365718575',owner_user_name='tempest-VolumesNegativeTest-1365718575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:48:41Z,user_data=None,user_id='31e2016c3ddf462b82363f1ed707ae79',uuid=8384fa60-36fd-4ad1-b397-8bc9ab088f01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "address": "fa:16:3e:0f:f4:63", "network": {"id": "9ccfe082-59ac-4f3e-b645-e7515227e74a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "496b19c3bbca416b90a414b3d4c03a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e35e03f-9a", "ovs_interfaceid": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Converting VIF {"id": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "address": "fa:16:3e:0f:f4:63", "network": {"id": "9ccfe082-59ac-4f3e-b645-e7515227e74a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "496b19c3bbca416b90a414b3d4c03a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e35e03f-9a", "ovs_interfaceid": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f4:63,bridge_name='br-int',has_traffic_filtering=True,id=0e35e03f-9a71-4d0a-afe6-ec888446e45c,network=Network(9ccfe082-59ac-4f3e-b645-e7515227e74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e35e03f-9a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.objects.instance [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lazy-loading 'pci_devices' on Instance uuid 8384fa60-36fd-4ad1-b397-8bc9ab088f01 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:48:43 user nova-compute[75813]:   <uuid>8384fa60-36fd-4ad1-b397-8bc9ab088f01</uuid>
Nov 15 12:48:43 user nova-compute[75813]:   <name>instance-00000009</name>
Nov 15 12:48:43 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:48:43 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:48:43 user nova-compute[75813]:   <metadata>
Nov 15 12:48:43 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:48:43 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:48:43 user nova-compute[75813]:       <nova:name>tempest-VolumesNegativeTest-instance-103586113</nova:name>
Nov 15 12:48:43 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:48:43</nova:creationTime>
Nov 15 12:48:43 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:48:43 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:48:43 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:48:43 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:48:43 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:48:43 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:48:43 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:48:43 user nova-compute[75813]:       <nova:owner>
Nov 15 12:48:43 user nova-compute[75813]:         <nova:user uuid="31e2016c3ddf462b82363f1ed707ae79">tempest-VolumesNegativeTest-1365718575-project-member</nova:user>
Nov 15 12:48:43 user nova-compute[75813]:         <nova:project uuid="f6a6313bfce446d1b2491e9bbbf11043">tempest-VolumesNegativeTest-1365718575</nova:project>
Nov 15 12:48:43 user nova-compute[75813]:       </nova:owner>
Nov 15 12:48:43 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:48:43 user nova-compute[75813]:       <nova:ports>
Nov 15 12:48:43 user nova-compute[75813]:         <nova:port uuid="0e35e03f-9a71-4d0a-afe6-ec888446e45c">
Nov 15 12:48:43 user nova-compute[75813]:           <nova:ip type="fixed" address="192.168.233.157" ipVersion="4"/>
Nov 15 12:48:43 user nova-compute[75813]:         </nova:port>
Nov 15 12:48:43 user nova-compute[75813]:       </nova:ports>
Nov 15 12:48:43 user nova-compute[75813]:     </nova:instance>
Nov 15 12:48:43 user nova-compute[75813]:   </metadata>
Nov 15 12:48:43 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:48:43 user nova-compute[75813]:     <system>
Nov 15 12:48:43 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:48:43 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:48:43 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:48:43 user nova-compute[75813]:       <entry name="serial">8384fa60-36fd-4ad1-b397-8bc9ab088f01</entry>
Nov 15 12:48:43 user nova-compute[75813]:       <entry name="uuid">8384fa60-36fd-4ad1-b397-8bc9ab088f01</entry>
Nov 15 12:48:43 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:48:43 user nova-compute[75813]:     </system>
Nov 15 12:48:43 user nova-compute[75813]:   </sysinfo>
Nov 15 12:48:43 user nova-compute[75813]:   <os>
Nov 15 12:48:43 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:48:43 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:48:43 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:48:43 user nova-compute[75813]:   </os>
Nov 15 12:48:43 user nova-compute[75813]:   <features>
Nov 15 12:48:43 user nova-compute[75813]:     <acpi/>
Nov 15 12:48:43 user nova-compute[75813]:     <apic/>
Nov 15 12:48:43 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:48:43 user nova-compute[75813]:   </features>
Nov 15 12:48:43 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:48:43 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:48:43 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:48:43 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:48:43 user nova-compute[75813]:   </clock>
Nov 15 12:48:43 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:48:43 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:48:43 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:48:43 user nova-compute[75813]:   </cpu>
Nov 15 12:48:43 user nova-compute[75813]:   <devices>
Nov 15 12:48:43 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:48:43 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:48:43 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk"/>
Nov 15 12:48:43 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:48:43 user nova-compute[75813]:     </disk>
Nov 15 12:48:43 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:48:43 user nova-compute[75813]:       <mac address="fa:16:3e:0f:f4:63"/>
Nov 15 12:48:43 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:48:43 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:48:43 user nova-compute[75813]:       <target dev="tap0e35e03f-9a"/>
Nov 15 12:48:43 user nova-compute[75813]:     </interface>
Nov 15 12:48:43 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:48:43 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/console.log" append="off"/>
Nov 15 12:48:43 user nova-compute[75813]:     </serial>
Nov 15 12:48:43 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:48:43 user nova-compute[75813]:     <video>
Nov 15 12:48:43 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:48:43 user nova-compute[75813]:     </video>
Nov 15 12:48:43 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:48:43 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:48:43 user nova-compute[75813]:     </rng>
Nov 15 12:48:43 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:48:43 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:48:43 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:48:43 user nova-compute[75813]:     </memballoon>
Nov 15 12:48:43 user nova-compute[75813]:   </devices>
Nov 15 12:48:43 user nova-compute[75813]: </domain>
Nov 15 12:48:43 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-103586113',display_name='tempest-VolumesNegativeTest-instance-103586113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-103586113',id=9,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6a6313bfce446d1b2491e9bbbf11043',ramdisk_id='',reservation_id='r-4o746nou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1365718575',owner_user_name='tempest-VolumesNegativeTest-1365718575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:48:41Z,user_data=None,user_id='31e2016c3ddf462b82363f1ed707ae79',uuid=8384fa60-36fd-4ad1-b397-8bc9ab088f01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "address": "fa:16:3e:0f:f4:63", "network": {"id": "9ccfe082-59ac-4f3e-b645-e7515227e74a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "496b19c3bbca416b90a414b3d4c03a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e35e03f-9a", "ovs_interfaceid": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Converting VIF {"id": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "address": "fa:16:3e:0f:f4:63", "network": {"id": "9ccfe082-59ac-4f3e-b645-e7515227e74a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "496b19c3bbca416b90a414b3d4c03a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e35e03f-9a", "ovs_interfaceid": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f4:63,bridge_name='br-int',has_traffic_filtering=True,id=0e35e03f-9a71-4d0a-afe6-ec888446e45c,network=Network(9ccfe082-59ac-4f3e-b645-e7515227e74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e35e03f-9a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG os_vif [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f4:63,bridge_name='br-int',has_traffic_filtering=True,id=0e35e03f-9a71-4d0a-afe6-ec888446e45c,network=Network(9ccfe082-59ac-4f3e-b645-e7515227e74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e35e03f-9a') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a80a8446-8475-5634-a405-5c4bba34627a', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e35e03f-9a, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e35e03f-9a, col_values=(('qos', UUID('7094553e-6e72-456e-924b-466738a8eb46')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e35e03f-9a, col_values=(('external_ids', {'iface-id': '0e35e03f-9a71-4d0a-afe6-ec888446e45c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:f4:63', 'vm-uuid': '8384fa60-36fd-4ad1-b397-8bc9ab088f01'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:43 user nova-compute[75813]: INFO os_vif [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f4:63,bridge_name='br-int',has_traffic_filtering=True,id=0e35e03f-9a71-4d0a-afe6-ec888446e45c,network=Network(9ccfe082-59ac-4f3e-b645-e7515227e74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e35e03f-9a')
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:48:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] No VIF found with MAC fa:16:3e:0f:f4:63, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:48:44 user nova-compute[75813]: DEBUG nova.network.neutron [req-098f10ed-217a-46dc-aa3e-5a08870d7eb1 req-8e01347b-fa98-4e76-9efd-85a0811fbca7 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Updated VIF entry in instance network info cache for port 0e35e03f-9a71-4d0a-afe6-ec888446e45c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:48:44 user nova-compute[75813]: DEBUG nova.network.neutron [req-098f10ed-217a-46dc-aa3e-5a08870d7eb1 req-8e01347b-fa98-4e76-9efd-85a0811fbca7 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Updating instance_info_cache with network_info: [{"id": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "address": "fa:16:3e:0f:f4:63", "network": {"id": "9ccfe082-59ac-4f3e-b645-e7515227e74a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "496b19c3bbca416b90a414b3d4c03a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e35e03f-9a", "ovs_interfaceid": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:48:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-098f10ed-217a-46dc-aa3e-5a08870d7eb1 req-8e01347b-fa98-4e76-9efd-85a0811fbca7 service nova] Releasing lock "refresh_cache-8384fa60-36fd-4ad1-b397-8bc9ab088f01" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:48:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-52495bd7-3997-4a0e-b557-d759c732f2a3 req-a8fdc643-20ac-4e1f-9345-989927d76d0c service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Received event network-vif-plugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-52495bd7-3997-4a0e-b557-d759c732f2a3 req-a8fdc643-20ac-4e1f-9345-989927d76d0c service nova] Acquiring lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-52495bd7-3997-4a0e-b557-d759c732f2a3 req-a8fdc643-20ac-4e1f-9345-989927d76d0c service nova] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-52495bd7-3997-4a0e-b557-d759c732f2a3 req-a8fdc643-20ac-4e1f-9345-989927d76d0c service nova] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-52495bd7-3997-4a0e-b557-d759c732f2a3 req-a8fdc643-20ac-4e1f-9345-989927d76d0c service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] No waiting events found dispatching network-vif-plugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:45 user nova-compute[75813]: WARNING nova.compute.manager [req-52495bd7-3997-4a0e-b557-d759c732f2a3 req-a8fdc643-20ac-4e1f-9345-989927d76d0c service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Received unexpected event network-vif-plugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c for instance with vm_state building and task_state spawning.
Nov 15 12:48:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:48:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Instance spawned successfully.
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:48:47 user nova-compute[75813]: INFO nova.compute.manager [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Took 6.45 seconds to spawn the instance on the hypervisor.
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-c596830c-113e-4e18-9aee-2475db7e1714 req-3a9693cb-4016-4a42-8a5b-377f75d549bd service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Received event network-vif-plugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c596830c-113e-4e18-9aee-2475db7e1714 req-3a9693cb-4016-4a42-8a5b-377f75d549bd service nova] Acquiring lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c596830c-113e-4e18-9aee-2475db7e1714 req-3a9693cb-4016-4a42-8a5b-377f75d549bd service nova] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c596830c-113e-4e18-9aee-2475db7e1714 req-3a9693cb-4016-4a42-8a5b-377f75d549bd service nova] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-c596830c-113e-4e18-9aee-2475db7e1714 req-3a9693cb-4016-4a42-8a5b-377f75d549bd service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] No waiting events found dispatching network-vif-plugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:48:47 user nova-compute[75813]: WARNING nova.compute.manager [req-c596830c-113e-4e18-9aee-2475db7e1714 req-3a9693cb-4016-4a42-8a5b-377f75d549bd service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Received unexpected event network-vif-plugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c for instance with vm_state building and task_state spawning.
Nov 15 12:48:47 user nova-compute[75813]: INFO nova.compute.manager [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Took 7.38 seconds to build instance.
Nov 15 12:48:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc8d77f2-153e-4714-9aa1-930411b77c0a tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.559s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:48:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:48:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "83094942-e15d-48c6-bc0d-7c98505eb535" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "83094942-e15d-48c6-bc0d-7c98505eb535" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG nova.compute.manager [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:49:24 user nova-compute[75813]: INFO nova.compute.claims [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Claim successful on node user
Nov 15 12:49:24 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG nova.compute.manager [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG nova.compute.manager [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG nova.network.neutron [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:49:24 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:49:24 user nova-compute[75813]: DEBUG nova.compute.manager [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG nova.policy [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46c14d0607324e6ba1e447b5f5945a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb93fcbc60e4efbb8d3bb0c657f1b64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG nova.compute.manager [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:49:24 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Creating image(s)
Nov 15 12:49:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "/opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "/opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "/opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk 1073741824" returned: 0 in 0.052s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG nova.network.neutron [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Successfully created port: 956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Cannot resize image /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Ensure instance console log exists: /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.network.neutron [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Successfully updated port: 956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "refresh_cache-83094942-e15d-48c6-bc0d-7c98505eb535" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquired lock "refresh_cache-83094942-e15d-48c6-bc0d-7c98505eb535" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.network.neutron [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-81e6fe0c-ca00-417c-ad2f-d40e31e460fa req-eda713bc-cbe4-4a6a-b475-2e2f80bb14a6 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Received event network-changed-956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-81e6fe0c-ca00-417c-ad2f-d40e31e460fa req-eda713bc-cbe4-4a6a-b475-2e2f80bb14a6 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Refreshing instance network info cache due to event network-changed-956d00c4-90f7-4885-acc3-b17afda2a416. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-81e6fe0c-ca00-417c-ad2f-d40e31e460fa req-eda713bc-cbe4-4a6a-b475-2e2f80bb14a6 service nova] Acquiring lock "refresh_cache-83094942-e15d-48c6-bc0d-7c98505eb535" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.network.neutron [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.network.neutron [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Updating instance_info_cache with network_info: [{"id": "956d00c4-90f7-4885-acc3-b17afda2a416", "address": "fa:16:3e:43:b0:5c", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956d00c4-90", "ovs_interfaceid": "956d00c4-90f7-4885-acc3-b17afda2a416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Releasing lock "refresh_cache-83094942-e15d-48c6-bc0d-7c98505eb535" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.compute.manager [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Instance network_info: |[{"id": "956d00c4-90f7-4885-acc3-b17afda2a416", "address": "fa:16:3e:43:b0:5c", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956d00c4-90", "ovs_interfaceid": "956d00c4-90f7-4885-acc3-b17afda2a416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-81e6fe0c-ca00-417c-ad2f-d40e31e460fa req-eda713bc-cbe4-4a6a-b475-2e2f80bb14a6 service nova] Acquired lock "refresh_cache-83094942-e15d-48c6-bc0d-7c98505eb535" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.network.neutron [req-81e6fe0c-ca00-417c-ad2f-d40e31e460fa req-eda713bc-cbe4-4a6a-b475-2e2f80bb14a6 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Refreshing network info cache for port 956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Start _get_guest_xml network_info=[{"id": "956d00c4-90f7-4885-acc3-b17afda2a416", "address": "fa:16:3e:43:b0:5c", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956d00c4-90", "ovs_interfaceid": "956d00c4-90f7-4885-acc3-b17afda2a416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:49:26 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:49:26 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1480907982',display_name='tempest-ServersNegativeTestJSON-server-1480907982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1480907982',id=10,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abb93fcbc60e4efbb8d3bb0c657f1b64',ramdisk_id='',reservation_id='r-lrwivclt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-880603076',owner_user_name='tempest-ServersNegativeTestJSON-880603076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:49:25Z,user_data=None,user_id='46c14d0607324e6ba1e447b5f5945a99',uuid=83094942-e15d-48c6-bc0d-7c98505eb535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "956d00c4-90f7-4885-acc3-b17afda2a416", "address": "fa:16:3e:43:b0:5c", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956d00c4-90", "ovs_interfaceid": "956d00c4-90f7-4885-acc3-b17afda2a416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converting VIF {"id": "956d00c4-90f7-4885-acc3-b17afda2a416", "address": "fa:16:3e:43:b0:5c", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956d00c4-90", "ovs_interfaceid": "956d00c4-90f7-4885-acc3-b17afda2a416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=956d00c4-90f7-4885-acc3-b17afda2a416,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956d00c4-90') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.objects.instance [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lazy-loading 'pci_devices' on Instance uuid 83094942-e15d-48c6-bc0d-7c98505eb535 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:49:26 user nova-compute[75813]:   <uuid>83094942-e15d-48c6-bc0d-7c98505eb535</uuid>
Nov 15 12:49:26 user nova-compute[75813]:   <name>instance-0000000a</name>
Nov 15 12:49:26 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:49:26 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:49:26 user nova-compute[75813]:   <metadata>
Nov 15 12:49:26 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:49:26 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:49:26 user nova-compute[75813]:       <nova:name>tempest-ServersNegativeTestJSON-server-1480907982</nova:name>
Nov 15 12:49:26 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:49:26</nova:creationTime>
Nov 15 12:49:26 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:49:26 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:49:26 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:49:26 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:49:26 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:49:26 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:49:26 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:49:26 user nova-compute[75813]:       <nova:owner>
Nov 15 12:49:26 user nova-compute[75813]:         <nova:user uuid="46c14d0607324e6ba1e447b5f5945a99">tempest-ServersNegativeTestJSON-880603076-project-member</nova:user>
Nov 15 12:49:26 user nova-compute[75813]:         <nova:project uuid="abb93fcbc60e4efbb8d3bb0c657f1b64">tempest-ServersNegativeTestJSON-880603076</nova:project>
Nov 15 12:49:26 user nova-compute[75813]:       </nova:owner>
Nov 15 12:49:26 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:49:26 user nova-compute[75813]:       <nova:ports>
Nov 15 12:49:26 user nova-compute[75813]:         <nova:port uuid="956d00c4-90f7-4885-acc3-b17afda2a416">
Nov 15 12:49:26 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 12:49:26 user nova-compute[75813]:         </nova:port>
Nov 15 12:49:26 user nova-compute[75813]:       </nova:ports>
Nov 15 12:49:26 user nova-compute[75813]:     </nova:instance>
Nov 15 12:49:26 user nova-compute[75813]:   </metadata>
Nov 15 12:49:26 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:49:26 user nova-compute[75813]:     <system>
Nov 15 12:49:26 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:49:26 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:49:26 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:49:26 user nova-compute[75813]:       <entry name="serial">83094942-e15d-48c6-bc0d-7c98505eb535</entry>
Nov 15 12:49:26 user nova-compute[75813]:       <entry name="uuid">83094942-e15d-48c6-bc0d-7c98505eb535</entry>
Nov 15 12:49:26 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:49:26 user nova-compute[75813]:     </system>
Nov 15 12:49:26 user nova-compute[75813]:   </sysinfo>
Nov 15 12:49:26 user nova-compute[75813]:   <os>
Nov 15 12:49:26 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:49:26 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:49:26 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:49:26 user nova-compute[75813]:   </os>
Nov 15 12:49:26 user nova-compute[75813]:   <features>
Nov 15 12:49:26 user nova-compute[75813]:     <acpi/>
Nov 15 12:49:26 user nova-compute[75813]:     <apic/>
Nov 15 12:49:26 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:49:26 user nova-compute[75813]:   </features>
Nov 15 12:49:26 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:49:26 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:49:26 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:49:26 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:49:26 user nova-compute[75813]:   </clock>
Nov 15 12:49:26 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:49:26 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:49:26 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:49:26 user nova-compute[75813]:   </cpu>
Nov 15 12:49:26 user nova-compute[75813]:   <devices>
Nov 15 12:49:26 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:49:26 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:49:26 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk"/>
Nov 15 12:49:26 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:49:26 user nova-compute[75813]:     </disk>
Nov 15 12:49:26 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:49:26 user nova-compute[75813]:       <mac address="fa:16:3e:43:b0:5c"/>
Nov 15 12:49:26 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:49:26 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:49:26 user nova-compute[75813]:       <target dev="tap956d00c4-90"/>
Nov 15 12:49:26 user nova-compute[75813]:     </interface>
Nov 15 12:49:26 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:49:26 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/console.log" append="off"/>
Nov 15 12:49:26 user nova-compute[75813]:     </serial>
Nov 15 12:49:26 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:49:26 user nova-compute[75813]:     <video>
Nov 15 12:49:26 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:49:26 user nova-compute[75813]:     </video>
Nov 15 12:49:26 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:49:26 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:49:26 user nova-compute[75813]:     </rng>
Nov 15 12:49:26 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:49:26 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:49:26 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:49:26 user nova-compute[75813]:     </memballoon>
Nov 15 12:49:26 user nova-compute[75813]:   </devices>
Nov 15 12:49:26 user nova-compute[75813]: </domain>
Nov 15 12:49:26 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1480907982',display_name='tempest-ServersNegativeTestJSON-server-1480907982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1480907982',id=10,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abb93fcbc60e4efbb8d3bb0c657f1b64',ramdisk_id='',reservation_id='r-lrwivclt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-880603076',owner_user_name='tempest-ServersNegativeTestJSON-880603076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:49:25Z,user_data=None,user_id='46c14d0607324e6ba1e447b5f5945a99',uuid=83094942-e15d-48c6-bc0d-7c98505eb535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "956d00c4-90f7-4885-acc3-b17afda2a416", "address": "fa:16:3e:43:b0:5c", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956d00c4-90", "ovs_interfaceid": "956d00c4-90f7-4885-acc3-b17afda2a416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converting VIF {"id": "956d00c4-90f7-4885-acc3-b17afda2a416", "address": "fa:16:3e:43:b0:5c", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956d00c4-90", "ovs_interfaceid": "956d00c4-90f7-4885-acc3-b17afda2a416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=956d00c4-90f7-4885-acc3-b17afda2a416,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956d00c4-90') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG os_vif [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=956d00c4-90f7-4885-acc3-b17afda2a416,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956d00c4-90') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4cbdcd7-9872-52c7-94cf-10e1000e5b27', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap956d00c4-90, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap956d00c4-90, col_values=(('qos', UUID('ce0f8ffb-554b-4e88-88bd-789e60c8bb86')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap956d00c4-90, col_values=(('external_ids', {'iface-id': '956d00c4-90f7-4885-acc3-b17afda2a416', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:b0:5c', 'vm-uuid': '83094942-e15d-48c6-bc0d-7c98505eb535'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:26 user nova-compute[75813]: INFO os_vif [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=956d00c4-90f7-4885-acc3-b17afda2a416,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956d00c4-90')
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:49:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] No VIF found with MAC fa:16:3e:43:b0:5c, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:49:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:27 user nova-compute[75813]: DEBUG nova.network.neutron [req-81e6fe0c-ca00-417c-ad2f-d40e31e460fa req-eda713bc-cbe4-4a6a-b475-2e2f80bb14a6 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Updated VIF entry in instance network info cache for port 956d00c4-90f7-4885-acc3-b17afda2a416. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:49:27 user nova-compute[75813]: DEBUG nova.network.neutron [req-81e6fe0c-ca00-417c-ad2f-d40e31e460fa req-eda713bc-cbe4-4a6a-b475-2e2f80bb14a6 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Updating instance_info_cache with network_info: [{"id": "956d00c4-90f7-4885-acc3-b17afda2a416", "address": "fa:16:3e:43:b0:5c", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956d00c4-90", "ovs_interfaceid": "956d00c4-90f7-4885-acc3-b17afda2a416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-81e6fe0c-ca00-417c-ad2f-d40e31e460fa req-eda713bc-cbe4-4a6a-b475-2e2f80bb14a6 service nova] Releasing lock "refresh_cache-83094942-e15d-48c6-bc0d-7c98505eb535" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG nova.compute.manager [req-b2438738-5c07-4296-88b9-e111c62360f0 req-1fb3c01d-2297-4650-8570-44bbbae586a6 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Received event network-vif-plugged-956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b2438738-5c07-4296-88b9-e111c62360f0 req-1fb3c01d-2297-4650-8570-44bbbae586a6 service nova] Acquiring lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b2438738-5c07-4296-88b9-e111c62360f0 req-1fb3c01d-2297-4650-8570-44bbbae586a6 service nova] Lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b2438738-5c07-4296-88b9-e111c62360f0 req-1fb3c01d-2297-4650-8570-44bbbae586a6 service nova] Lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG nova.compute.manager [req-b2438738-5c07-4296-88b9-e111c62360f0 req-1fb3c01d-2297-4650-8570-44bbbae586a6 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] No waiting events found dispatching network-vif-plugged-956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:49:28 user nova-compute[75813]: WARNING nova.compute.manager [req-b2438738-5c07-4296-88b9-e111c62360f0 req-1fb3c01d-2297-4650-8570-44bbbae586a6 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Received unexpected event network-vif-plugged-956d00c4-90f7-4885-acc3-b17afda2a416 for instance with vm_state building and task_state spawning.
Nov 15 12:49:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG nova.objects.instance [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lazy-loading 'flavor' on Instance uuid 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:49:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:29 user nova-compute[75813]: INFO nova.compute.manager [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Attaching volume e14226b7-42d5-4b31-822e-9a183e4bf0bb to /dev/vdb
Nov 15 12:49:29 user nova-compute[75813]: DEBUG os_brick.utils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:49:29 user nova-compute[75813]: INFO oslo.privsep.daemon [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp7tf31mk3/privsep.sock']
Nov 15 12:49:29 user sudo[87164]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp7tf31mk3/privsep.sock
Nov 15 12:49:29 user sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 12:49:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.compute.manager [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:49:30 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Instance spawned successfully.
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.compute.manager [req-58cd30e3-3732-40c7-a22b-78c2fe35e392 req-7c2178cf-fd9f-41d0-a775-48e501cef959 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Received event network-vif-plugged-956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-58cd30e3-3732-40c7-a22b-78c2fe35e392 req-7c2178cf-fd9f-41d0-a775-48e501cef959 service nova] Acquiring lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-58cd30e3-3732-40c7-a22b-78c2fe35e392 req-7c2178cf-fd9f-41d0-a775-48e501cef959 service nova] Lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-58cd30e3-3732-40c7-a22b-78c2fe35e392 req-7c2178cf-fd9f-41d0-a775-48e501cef959 service nova] Lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.compute.manager [req-58cd30e3-3732-40c7-a22b-78c2fe35e392 req-7c2178cf-fd9f-41d0-a775-48e501cef959 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] No waiting events found dispatching network-vif-plugged-956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:49:30 user nova-compute[75813]: WARNING nova.compute.manager [req-58cd30e3-3732-40c7-a22b-78c2fe35e392 req-7c2178cf-fd9f-41d0-a775-48e501cef959 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Received unexpected event network-vif-plugged-956d00c4-90f7-4885-acc3-b17afda2a416 for instance with vm_state building and task_state spawning.
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:30 user nova-compute[75813]: INFO nova.compute.manager [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 15 12:49:30 user nova-compute[75813]: DEBUG nova.compute.manager [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:49:30 user nova-compute[75813]: INFO nova.compute.manager [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Took 6.27 seconds to build instance.
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-88121045-d763-4ffb-9618-8efbaefde296 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "83094942-e15d-48c6-bc0d-7c98505eb535" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.369s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:30 user sudo[87164]: pam_unix(sudo:session): session closed for user root
Nov 15 12:49:30 user nova-compute[75813]: INFO oslo.privsep.daemon [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Spawned new privsep daemon via rootwrap
Nov 15 12:49:30 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 12:49:30 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 12:49:30 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 12:49:30 user nova-compute[75813]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87167
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[78217e42-0110-4a1f-9709-3f1f1c3d7079]: (2,) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b0a415-3b8b-4f24-b896-4233c329b3ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:30 user nova-compute[75813]: WARNING os_brick.initiator.connectors.nvmeof [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[194d19c8-ecdd-4302-a648-cb80285c30f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf25ea0-f358-4812-8243-5d3538fb3a7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[28178886-2adc-488b-a382-33e8779ab653]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:49:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:49:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:49:31 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:49:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2f0e8f-7128-4b1b-b8c7-ea11b10ce6a0]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:49:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:49:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:49:31 user nova-compute[75813]: DEBUG os_brick.utils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] <== get_connector_properties: return (1741ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:49:31 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Updating existing volume attachment record: 86eed4d7-c0cf-4447-8088-a0020f101407 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:49:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-1e51cf10-c9bd-4cc7-b83e-528fc0f52681 req-54265110-8f56-4176-8312-91d77354416f service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Received event network-changed-63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-1e51cf10-c9bd-4cc7-b83e-528fc0f52681 req-54265110-8f56-4176-8312-91d77354416f service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Refreshing instance network info cache due to event network-changed-63994e7d-b489-40f0-8233-d6f6313be4ad. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:49:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1e51cf10-c9bd-4cc7-b83e-528fc0f52681 req-54265110-8f56-4176-8312-91d77354416f service nova] Acquiring lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:49:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1e51cf10-c9bd-4cc7-b83e-528fc0f52681 req-54265110-8f56-4176-8312-91d77354416f service nova] Acquired lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:49:32 user nova-compute[75813]: DEBUG nova.network.neutron [req-1e51cf10-c9bd-4cc7-b83e-528fc0f52681 req-54265110-8f56-4176-8312-91d77354416f service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Refreshing network info cache for port 63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:49:33 user nova-compute[75813]: DEBUG nova.network.neutron [req-1e51cf10-c9bd-4cc7-b83e-528fc0f52681 req-54265110-8f56-4176-8312-91d77354416f service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Updated VIF entry in instance network info cache for port 63994e7d-b489-40f0-8233-d6f6313be4ad. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:49:33 user nova-compute[75813]: DEBUG nova.network.neutron [req-1e51cf10-c9bd-4cc7-b83e-528fc0f52681 req-54265110-8f56-4176-8312-91d77354416f service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Updating instance_info_cache with network_info: [{"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1e51cf10-c9bd-4cc7-b83e-528fc0f52681 req-54265110-8f56-4176-8312-91d77354416f service nova] Releasing lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:49:34 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:49:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-a4d9aa14-dda4-4f6e-8917-70645e2ccf65 req-a28cc391-f7fb-44a6-a579-9d3f8d44b39b service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-changed-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-a4d9aa14-dda4-4f6e-8917-70645e2ccf65 req-a28cc391-f7fb-44a6-a579-9d3f8d44b39b service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Refreshing instance network info cache due to event network-changed-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:49:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a4d9aa14-dda4-4f6e-8917-70645e2ccf65 req-a28cc391-f7fb-44a6-a579-9d3f8d44b39b service nova] Acquiring lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:49:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a4d9aa14-dda4-4f6e-8917-70645e2ccf65 req-a28cc391-f7fb-44a6-a579-9d3f8d44b39b service nova] Acquired lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:49:34 user nova-compute[75813]: DEBUG nova.network.neutron [req-a4d9aa14-dda4-4f6e-8917-70645e2ccf65 req-a28cc391-f7fb-44a6-a579-9d3f8d44b39b service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Refreshing network info cache for port 1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:49:34 user nova-compute[75813]: DEBUG nova.network.neutron [req-a4d9aa14-dda4-4f6e-8917-70645e2ccf65 req-a28cc391-f7fb-44a6-a579-9d3f8d44b39b service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updated VIF entry in instance network info cache for port 1d4549cc-1d5a-4548-86d8-1832e8ce3d4c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:49:34 user nova-compute[75813]: DEBUG nova.network.neutron [req-a4d9aa14-dda4-4f6e-8917-70645e2ccf65 req-a28cc391-f7fb-44a6-a579-9d3f8d44b39b service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating instance_info_cache with network_info: [{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a4d9aa14-dda4-4f6e-8917-70645e2ccf65 req-a28cc391-f7fb-44a6-a579-9d3f8d44b39b service nova] Releasing lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG nova.objects.instance [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'flavor' on Instance uuid 48d7cb39-a436-4b01-87cc-77e917ac5c0e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:35 user nova-compute[75813]: INFO nova.compute.manager [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Attaching volume 2550b973-6759-4b8f-9f0f-cda4ac19d357 to /dev/vdb
Nov 15 12:49:35 user nova-compute[75813]: DEBUG os_brick.utils [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7e4b34-045e-46d5-885b-606ccfa6a580]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bf7947-62ca-4663-8a17-b295f40d5f09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68893b3-13f1-447e-a336-b99cec7b9cb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[30001cfb-d3ba-4cb0-8a05-8d819ef9a1ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:49:36 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd094f77-2635-4dd9-aaea-61a45966853e]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.utils [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Updating existing volume attachment record: ba4b5c0c-f05c-447f-902a-60ec14a5d10d {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connector [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Factory for ISCSI on None {{(pid=75813) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upoyKWVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:49:36 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:49:36 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:49:36 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e475586-7e2c-4da5-b078-f11a6f386af6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:49:36 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cfa76a-8463-4cba-9049-90b3c633d793]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb] added
Nov 15 12:49:36 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e333bf5-2bdd-4eb2-9da2-5bf4e1535b31]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a55bd6-75a6-4411-a209-5c4c8ed7b996]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upoyKWVv {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upoyKWVv" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bd2128-5af8-403c-935e-284660eda2b8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'upoyKWVv'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[961054e0-cd3f-4365-9467-a844ef091dcb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba2f5c4-ceb9-4c15-a090-cb9bbaa0ab19]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:49:36 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:49:36 user nova-compute[75813]:  {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:49:36 user nova-compute[75813]: WARNING os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 12:49:36 user nova-compute[75813]: 
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cda9f0b-5998-4dd4-85bc-89bf729df42b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb, portal: 172.16.0.220,3260]
Nov 15 12:49:36 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb, portal: 172.16.0.220,3260] successful.
Nov 15 12:49:36 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea77b6a6-2631-4e1c-b411-2db30a5f6ffa]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34421cf-7c69-43dc-b7b7-80989e418f74]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb (non-flash)
Nov 15 12:49:36 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb (non-flash)
Nov 15 12:49:36 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a21c209-6c30-4e05-ac1c-4c838881a68e]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upoyKWVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:49:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Updating instance_info_cache with network_info: [{"id": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "address": "fa:16:3e:69:f1:a6", "network": {"id": "dfc5cc02-1e20-49c8-b735-f79be1a7aea5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-10087224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9920f3cb902f491b848d660c757eab49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732fb6f-0b", "ovs_interfaceid": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26163353430316435', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163353430316435', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG nova.objects.instance [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lazy-loading 'flavor' on Instance uuid 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:49:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:49:37 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:49:37 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 12:49:37 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:49:37 user nova-compute[75813]:   <serial>e14226b7-42d5-4b31-822e-9a183e4bf0bb</serial>
Nov 15 12:49:37 user nova-compute[75813]: </disk>
Nov 15 12:49:37 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] No VIF found with MAC fa:16:3e:69:f1:a6, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-631a7f7a-6fa3-456f-a4a6-edaf314dfdd3 tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.124s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:39 user nova-compute[75813]: INFO nova.compute.manager [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Terminating instance
Nov 15 12:49:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-d1cc46fb-a8c6-4386-8717-72d6eebdf680 req-0442563c-26d9-4a4b-801e-eaa2a8421409 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Received event network-vif-unplugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d1cc46fb-a8c6-4386-8717-72d6eebdf680 req-0442563c-26d9-4a4b-801e-eaa2a8421409 service nova] Acquiring lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d1cc46fb-a8c6-4386-8717-72d6eebdf680 req-0442563c-26d9-4a4b-801e-eaa2a8421409 service nova] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d1cc46fb-a8c6-4386-8717-72d6eebdf680 req-0442563c-26d9-4a4b-801e-eaa2a8421409 service nova] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-d1cc46fb-a8c6-4386-8717-72d6eebdf680 req-0442563c-26d9-4a4b-801e-eaa2a8421409 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] No waiting events found dispatching network-vif-unplugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-d1cc46fb-a8c6-4386-8717-72d6eebdf680 req-0442563c-26d9-4a4b-801e-eaa2a8421409 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Received event network-vif-unplugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Instance destroyed successfully.
Nov 15 12:49:40 user nova-compute[75813]: DEBUG nova.objects.instance [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lazy-loading 'resources' on Instance uuid 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-187072227',display_name='tempest-DeleteServersTestJSON-server-187072227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-187072227',id=2,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:47:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9920f3cb902f491b848d660c757eab49',ramdisk_id='',reservation_id='r-s4nc2rx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1142355133',owner_user_name='tempest-DeleteServersTestJSON-1142355133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:47:51Z,user_data=None,user_id='be1459c348da4131bb1c97ceba21bdd4',uuid=7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "address": "fa:16:3e:69:f1:a6", "network": {"id": "dfc5cc02-1e20-49c8-b735-f79be1a7aea5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-10087224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9920f3cb902f491b848d660c757eab49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732fb6f-0b", "ovs_interfaceid": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Converting VIF {"id": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "address": "fa:16:3e:69:f1:a6", "network": {"id": "dfc5cc02-1e20-49c8-b735-f79be1a7aea5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-10087224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9920f3cb902f491b848d660c757eab49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732fb6f-0b", "ovs_interfaceid": "1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:f1:a6,bridge_name='br-int',has_traffic_filtering=True,id=1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd,network=Network(dfc5cc02-1e20-49c8-b735-f79be1a7aea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1732fb6f-0b') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_vif [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:f1:a6,bridge_name='br-int',has_traffic_filtering=True,id=1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd,network=Network(dfc5cc02-1e20-49c8-b735-f79be1a7aea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1732fb6f-0b') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1732fb6f-0b, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7846ea1-d6a4-45d8-80a0-de3d2ec5a0df) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:40 user nova-compute[75813]: INFO os_vif [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:f1:a6,bridge_name='br-int',has_traffic_filtering=True,id=1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd,network=Network(dfc5cc02-1e20-49c8-b735-f79be1a7aea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1732fb6f-0b')
Nov 15 12:49:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upoyKWVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:49:40 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ba8c58-7eea-4197-b448-ad5abf2eb55e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:49:40 user nova-compute[75813]: No targets found.
Nov 15 12:49:40 user nova-compute[75813]: iSNS:
Nov 15 12:49:40 user nova-compute[75813]: No targets found.
Nov 15 12:49:40 user nova-compute[75813]: STATIC:
Nov 15 12:49:40 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb
Nov 15 12:49:40 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:49:40 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:49:40 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413
Nov 15 12:49:40 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:49:40 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:49:40 user nova-compute[75813]: FIRMWARE:
Nov 15 12:49:40 user nova-compute[75813]: No targets found.
Nov 15 12:49:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:49:40 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:49:40 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ef6a4-5530-4914-963a-985c65574832]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae472ff5-b93c-46a4-a2f7-c568f57d5fde]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb (non-flash)
Nov 15 12:49:40 user nova-compute[75813]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)
Nov 15 12:49:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb (non-flash)
Nov 15 12:49:40 user nova-compute[75813]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)
Nov 15 12:49:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55504fb130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d0c558-a9ee-4b0d-8619-b64382df4379]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b62e22-077e-4c6b-94e4-60f6b69f91f7]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[33121df9-61c7-46ce-b6ff-099e0077caa5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4562824a-ec8e-4fc3-bffe-25c2e914df35]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca233ef-0ebd-46f6-8aa6-97b800c831d7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8ee351-7a53-4611-89de-5dd284c71589]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb, portal: 172.16.0.220,3260]
Nov 15 12:49:40 user nova-compute[75813]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb, portal: 172.16.0.220,3260] successful.
Nov 15 12:49:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e14226b7-42d5-4b31-822e-9a183e4bf0bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[869762c6-c9a1-4bd9-b7ef-832424b2f832]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] <== disconnect_volume: return (338ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:49:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Deleting instance files /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3_del
Nov 15 12:49:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Deletion of /opt/stack/data/nova/instances/7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3_del complete
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75813) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 12:49:40 user nova-compute[75813]: INFO nova.virt.libvirt.host [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] UEFI support detected
Nov 15 12:49:40 user nova-compute[75813]: INFO nova.compute.manager [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 15 12:49:40 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:49:40 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRDjiVya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:49:41 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:49:41 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:49:41 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3c8a3d-c3f9-407b-b97b-6770347e73f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:49:41 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a14d35a-0cd1-4fc8-b455-a72b50073a70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357] added
Nov 15 12:49:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f62695f-74d8-485b-bd62-b32dde49bffc]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[557da662-cf32-4576-b825-9f11aafec952]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRDjiVya {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRDjiVya" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f60cf41-70d6-4002-bdd0-fcd7a68126ea]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pRDjiVya'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac54ce7b-2888-4fd8-8bf7-138f2adb2f35]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63c2d2d-816b-42ec-bc42-31a24cebf433]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)
Nov 15 12:49:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)
Nov 15 12:49:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Error from libvirt while getting description of instance-00000002: [Error Code 42] Domain not found: no domain with matching uuid '7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3' (instance-00000002): libvirt.libvirtError: Domain not found: no domain with matching uuid '7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3' (instance-00000002)
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[840052fc-889d-40f8-98cb-80595c85e5f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357, portal: 172.16.0.220,3260]
Nov 15 12:49:41 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357, portal: 172.16.0.220,3260] successful.
Nov 15 12:49:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2d5b42-f4ee-4dfd-be7c-3780c65fc104]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[862a37f5-c27c-4a52-a04a-2fc78cfb0766]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)
Nov 15 12:49:41 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:49:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)
Nov 15 12:49:41 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:49:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22c4ecb-ccf1-4f9b-8e03-a8aac86d85a7]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-d12def6f-947c-43b3-80f7-fd9251179686 req-283f0115-54eb-482d-ab2f-08f107b23cb5 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Received event network-vif-deleted-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:42 user nova-compute[75813]: INFO nova.compute.manager [req-d12def6f-947c-43b3-80f7-fd9251179686 req-283f0115-54eb-482d-ab2f-08f107b23cb5 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Neutron deleted interface 1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd; detaching it from the instance and deleting it from the info cache
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.network.neutron [req-d12def6f-947c-43b3-80f7-fd9251179686 req-283f0115-54eb-482d-ab2f-08f107b23cb5 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-f66b4045-66c3-4748-b986-911785fca522 req-1f8b4f18-588e-47aa-9211-c452e5a4b380 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Received event network-vif-plugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f66b4045-66c3-4748-b986-911785fca522 req-1f8b4f18-588e-47aa-9211-c452e5a4b380 service nova] Acquiring lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f66b4045-66c3-4748-b986-911785fca522 req-1f8b4f18-588e-47aa-9211-c452e5a4b380 service nova] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f66b4045-66c3-4748-b986-911785fca522 req-1f8b4f18-588e-47aa-9211-c452e5a4b380 service nova] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-f66b4045-66c3-4748-b986-911785fca522 req-1f8b4f18-588e-47aa-9211-c452e5a4b380 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] No waiting events found dispatching network-vif-plugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:49:42 user nova-compute[75813]: WARNING nova.compute.manager [req-f66b4045-66c3-4748-b986-911785fca522 req-1f8b4f18-588e-47aa-9211-c452e5a4b380 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Received unexpected event network-vif-plugged-1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd for instance with vm_state active and task_state deleting.
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:42 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:49:42 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7263MB free_disk=25.37371063232422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:42 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Took 1.17 seconds to deallocate network for instance.
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-d12def6f-947c-43b3-80f7-fd9251179686 req-283f0115-54eb-482d-ab2f-08f107b23cb5 service nova] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Detach interface failed, port_id=1732fb6f-0bdb-4db4-a7ef-ac876f6b04bd, reason: Instance 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3 could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 870cf760-ae0c-4df1-99cf-6403d8e642ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 36b32262-4ea0-4a33-9672-82c7b8061bb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ec571e3e-90e0-47d4-b1ae-98a356dc43f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 43f11322-00e7-472d-91f9-48ac1b16f33c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 0e47f02a-040d-422f-8847-40eb19df4073 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 3d4122cd-dafe-4dd0-b7e6-38125513807f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 8384fa60-36fd-4ad1-b397-8bc9ab088f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 83094942-e15d-48c6-bc0d-7c98505eb535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRDjiVya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26134333634386331', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134333634386331', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.objects.instance [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'flavor' on Instance uuid 48d7cb39-a436-4b01-87cc-77e917ac5c0e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:49:42 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:49:42 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 12:49:42 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:49:42 user nova-compute[75813]:   <serial>2550b973-6759-4b8f-9f0f-cda4ac19d357</serial>
Nov 15 12:49:42 user nova-compute[75813]: </disk>
Nov 15 12:49:42 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No VIF found with MAC fa:16:3e:f0:a6:95, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:49:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5443e90e-0a55-41fa-b230-840daf468db4 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.049s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:43 user nova-compute[75813]: INFO nova.compute.manager [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] [instance: 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3] Took 0.97 seconds to detach 1 volumes for instance.
Nov 15 12:49:43 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:49:43 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:49:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:43 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:49:43 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:49:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:43 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Deleted allocations for instance 7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3
Nov 15 12:49:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-077da13a-ba1d-42e6-9ac5-a5872c0d3e9f tempest-DeleteServersTestJSON-1142355133 tempest-DeleteServersTestJSON-1142355133-project-member] Lock "7ce3f9d4-20dc-4b9b-b16f-9ba6495debd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.058s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:49:46 user nova-compute[75813]: INFO nova.compute.claims [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Claim successful on node user
Nov 15 12:49:46 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:49:46 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:49:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG nova.policy [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66e8cb4b92ee40b9875ac675ec63b982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb2a7b27b904d639b7df886781d587f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:49:46 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Creating image(s)
Nov 15 12:49:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "/opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "/opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.166s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk 1073741824" returned: 0 in 0.044s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Successfully created port: 89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Cannot resize image /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Ensure instance console log exists: /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Successfully updated port: 89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "refresh_cache-d5a3f7e0-b467-4653-894e-7a5f11c9b971" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquired lock "refresh_cache-d5a3f7e0-b467-4653-894e-7a5f11c9b971" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-3578eca8-51e2-4fa5-b153-32340b650872 req-43837990-ae6f-47c2-be69-e1d7c627d98c service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Received event network-changed-89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-3578eca8-51e2-4fa5-b153-32340b650872 req-43837990-ae6f-47c2-be69-e1d7c627d98c service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Refreshing instance network info cache due to event network-changed-89a522a0-b643-4aae-be18-487bc2d1da47. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3578eca8-51e2-4fa5-b153-32340b650872 req-43837990-ae6f-47c2-be69-e1d7c627d98c service nova] Acquiring lock "refresh_cache-d5a3f7e0-b467-4653-894e-7a5f11c9b971" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:49:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.network.neutron [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Updating instance_info_cache with network_info: [{"id": "89a522a0-b643-4aae-be18-487bc2d1da47", "address": "fa:16:3e:4c:36:d2", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a522a0-b6", "ovs_interfaceid": "89a522a0-b643-4aae-be18-487bc2d1da47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Releasing lock "refresh_cache-d5a3f7e0-b467-4653-894e-7a5f11c9b971" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Instance network_info: |[{"id": "89a522a0-b643-4aae-be18-487bc2d1da47", "address": "fa:16:3e:4c:36:d2", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a522a0-b6", "ovs_interfaceid": "89a522a0-b643-4aae-be18-487bc2d1da47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3578eca8-51e2-4fa5-b153-32340b650872 req-43837990-ae6f-47c2-be69-e1d7c627d98c service nova] Acquired lock "refresh_cache-d5a3f7e0-b467-4653-894e-7a5f11c9b971" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-3578eca8-51e2-4fa5-b153-32340b650872 req-43837990-ae6f-47c2-be69-e1d7c627d98c service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Refreshing network info cache for port 89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Start _get_guest_xml network_info=[{"id": "89a522a0-b643-4aae-be18-487bc2d1da47", "address": "fa:16:3e:4c:36:d2", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a522a0-b6", "ovs_interfaceid": "89a522a0-b643-4aae-be18-487bc2d1da47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:49:48 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:49:48 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1551187316',display_name='tempest-AttachVolumeNegativeTest-server-1551187316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1551187316',id=11,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgPVVfO8wR9IJ0IF63tQcKXX0ONdo47kl95Ew+afbcOnrtgEwLnSU7UMAH9huOm9t3BlQ/moM1a0tXyHT4v02wfBBnUP5qOGIreHc2DDAl6uDKl//wR7+N+ORIKRqjNEQ==',key_name='tempest-keypair-1851397636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-p82s8rjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:49:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=d5a3f7e0-b467-4653-894e-7a5f11c9b971,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89a522a0-b643-4aae-be18-487bc2d1da47", "address": "fa:16:3e:4c:36:d2", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a522a0-b6", "ovs_interfaceid": "89a522a0-b643-4aae-be18-487bc2d1da47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "89a522a0-b643-4aae-be18-487bc2d1da47", "address": "fa:16:3e:4c:36:d2", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a522a0-b6", "ovs_interfaceid": "89a522a0-b643-4aae-be18-487bc2d1da47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:36:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a522a0-b643-4aae-be18-487bc2d1da47,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a522a0-b6') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.objects.instance [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'pci_devices' on Instance uuid d5a3f7e0-b467-4653-894e-7a5f11c9b971 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:49:48 user nova-compute[75813]:   <uuid>d5a3f7e0-b467-4653-894e-7a5f11c9b971</uuid>
Nov 15 12:49:48 user nova-compute[75813]:   <name>instance-0000000b</name>
Nov 15 12:49:48 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:49:48 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:49:48 user nova-compute[75813]:   <metadata>
Nov 15 12:49:48 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:49:48 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:49:48 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1551187316</nova:name>
Nov 15 12:49:48 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:49:48</nova:creationTime>
Nov 15 12:49:48 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:49:48 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:49:48 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:49:48 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:49:48 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:49:48 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:49:48 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:49:48 user nova-compute[75813]:       <nova:owner>
Nov 15 12:49:48 user nova-compute[75813]:         <nova:user uuid="66e8cb4b92ee40b9875ac675ec63b982">tempest-AttachVolumeNegativeTest-1316863353-project-member</nova:user>
Nov 15 12:49:48 user nova-compute[75813]:         <nova:project uuid="9cb2a7b27b904d639b7df886781d587f">tempest-AttachVolumeNegativeTest-1316863353</nova:project>
Nov 15 12:49:48 user nova-compute[75813]:       </nova:owner>
Nov 15 12:49:48 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:49:48 user nova-compute[75813]:       <nova:ports>
Nov 15 12:49:48 user nova-compute[75813]:         <nova:port uuid="89a522a0-b643-4aae-be18-487bc2d1da47">
Nov 15 12:49:48 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 12:49:48 user nova-compute[75813]:         </nova:port>
Nov 15 12:49:48 user nova-compute[75813]:       </nova:ports>
Nov 15 12:49:48 user nova-compute[75813]:     </nova:instance>
Nov 15 12:49:48 user nova-compute[75813]:   </metadata>
Nov 15 12:49:48 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:49:48 user nova-compute[75813]:     <system>
Nov 15 12:49:48 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:49:48 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:49:48 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:49:48 user nova-compute[75813]:       <entry name="serial">d5a3f7e0-b467-4653-894e-7a5f11c9b971</entry>
Nov 15 12:49:48 user nova-compute[75813]:       <entry name="uuid">d5a3f7e0-b467-4653-894e-7a5f11c9b971</entry>
Nov 15 12:49:48 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:49:48 user nova-compute[75813]:     </system>
Nov 15 12:49:48 user nova-compute[75813]:   </sysinfo>
Nov 15 12:49:48 user nova-compute[75813]:   <os>
Nov 15 12:49:48 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:49:48 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:49:48 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:49:48 user nova-compute[75813]:   </os>
Nov 15 12:49:48 user nova-compute[75813]:   <features>
Nov 15 12:49:48 user nova-compute[75813]:     <acpi/>
Nov 15 12:49:48 user nova-compute[75813]:     <apic/>
Nov 15 12:49:48 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:49:48 user nova-compute[75813]:   </features>
Nov 15 12:49:48 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:49:48 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:49:48 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:49:48 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:49:48 user nova-compute[75813]:   </clock>
Nov 15 12:49:48 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:49:48 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:49:48 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:49:48 user nova-compute[75813]:   </cpu>
Nov 15 12:49:48 user nova-compute[75813]:   <devices>
Nov 15 12:49:48 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:49:48 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:49:48 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk"/>
Nov 15 12:49:48 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:49:48 user nova-compute[75813]:     </disk>
Nov 15 12:49:48 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:49:48 user nova-compute[75813]:       <mac address="fa:16:3e:4c:36:d2"/>
Nov 15 12:49:48 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:49:48 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:49:48 user nova-compute[75813]:       <target dev="tap89a522a0-b6"/>
Nov 15 12:49:48 user nova-compute[75813]:     </interface>
Nov 15 12:49:48 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:49:48 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/console.log" append="off"/>
Nov 15 12:49:48 user nova-compute[75813]:     </serial>
Nov 15 12:49:48 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:49:48 user nova-compute[75813]:     <video>
Nov 15 12:49:48 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:49:48 user nova-compute[75813]:     </video>
Nov 15 12:49:48 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:49:48 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:49:48 user nova-compute[75813]:     </rng>
Nov 15 12:49:48 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:49:48 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:49:48 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:49:48 user nova-compute[75813]:     </memballoon>
Nov 15 12:49:48 user nova-compute[75813]:   </devices>
Nov 15 12:49:48 user nova-compute[75813]: </domain>
Nov 15 12:49:48 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1551187316',display_name='tempest-AttachVolumeNegativeTest-server-1551187316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1551187316',id=11,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgPVVfO8wR9IJ0IF63tQcKXX0ONdo47kl95Ew+afbcOnrtgEwLnSU7UMAH9huOm9t3BlQ/moM1a0tXyHT4v02wfBBnUP5qOGIreHc2DDAl6uDKl//wR7+N+ORIKRqjNEQ==',key_name='tempest-keypair-1851397636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-p82s8rjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:49:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=d5a3f7e0-b467-4653-894e-7a5f11c9b971,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89a522a0-b643-4aae-be18-487bc2d1da47", "address": "fa:16:3e:4c:36:d2", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a522a0-b6", "ovs_interfaceid": "89a522a0-b643-4aae-be18-487bc2d1da47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "89a522a0-b643-4aae-be18-487bc2d1da47", "address": "fa:16:3e:4c:36:d2", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a522a0-b6", "ovs_interfaceid": "89a522a0-b643-4aae-be18-487bc2d1da47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:36:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a522a0-b643-4aae-be18-487bc2d1da47,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a522a0-b6') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG os_vif [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:36:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a522a0-b643-4aae-be18-487bc2d1da47,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a522a0-b6') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f954011b-af59-5d41-817a-2a51ce745b45', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89a522a0-b6, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89a522a0-b6, col_values=(('qos', UUID('3a300267-b18f-4040-979f-7579fac323e2')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89a522a0-b6, col_values=(('external_ids', {'iface-id': '89a522a0-b643-4aae-be18-487bc2d1da47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:36:d2', 'vm-uuid': 'd5a3f7e0-b467-4653-894e-7a5f11c9b971'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:48 user nova-compute[75813]: INFO os_vif [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:36:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a522a0-b643-4aae-be18-487bc2d1da47,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a522a0-b6')
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No VIF found with MAC fa:16:3e:4c:36:d2, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-3578eca8-51e2-4fa5-b153-32340b650872 req-43837990-ae6f-47c2-be69-e1d7c627d98c service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Updated VIF entry in instance network info cache for port 89a522a0-b643-4aae-be18-487bc2d1da47. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-3578eca8-51e2-4fa5-b153-32340b650872 req-43837990-ae6f-47c2-be69-e1d7c627d98c service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Updating instance_info_cache with network_info: [{"id": "89a522a0-b643-4aae-be18-487bc2d1da47", "address": "fa:16:3e:4c:36:d2", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a522a0-b6", "ovs_interfaceid": "89a522a0-b643-4aae-be18-487bc2d1da47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3578eca8-51e2-4fa5-b153-32340b650872 req-43837990-ae6f-47c2-be69-e1d7c627d98c service nova] Releasing lock "refresh_cache-d5a3f7e0-b467-4653-894e-7a5f11c9b971" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:49:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-dda86316-fb8c-40ee-8641-73dab85465b1 req-e91235e0-cdaf-4607-a3f7-0e7d0a31bde6 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Received event network-vif-plugged-89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dda86316-fb8c-40ee-8641-73dab85465b1 req-e91235e0-cdaf-4607-a3f7-0e7d0a31bde6 service nova] Acquiring lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dda86316-fb8c-40ee-8641-73dab85465b1 req-e91235e0-cdaf-4607-a3f7-0e7d0a31bde6 service nova] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dda86316-fb8c-40ee-8641-73dab85465b1 req-e91235e0-cdaf-4607-a3f7-0e7d0a31bde6 service nova] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-dda86316-fb8c-40ee-8641-73dab85465b1 req-e91235e0-cdaf-4607-a3f7-0e7d0a31bde6 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] No waiting events found dispatching network-vif-plugged-89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:49:49 user nova-compute[75813]: WARNING nova.compute.manager [req-dda86316-fb8c-40ee-8641-73dab85465b1 req-e91235e0-cdaf-4607-a3f7-0e7d0a31bde6 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Received unexpected event network-vif-plugged-89a522a0-b643-4aae-be18-487bc2d1da47 for instance with vm_state building and task_state spawning.
Nov 15 12:49:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-5ba27468-53b6-4780-810a-b304c096d2dd req-eb74e6e1-4b0b-4e11-9766-27f6e57372fd service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Received event network-changed-96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-5ba27468-53b6-4780-810a-b304c096d2dd req-eb74e6e1-4b0b-4e11-9766-27f6e57372fd service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Refreshing instance network info cache due to event network-changed-96d6bc55-a485-4bfe-8bc5-b6978bababb3. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5ba27468-53b6-4780-810a-b304c096d2dd req-eb74e6e1-4b0b-4e11-9766-27f6e57372fd service nova] Acquiring lock "refresh_cache-ec571e3e-90e0-47d4-b1ae-98a356dc43f6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5ba27468-53b6-4780-810a-b304c096d2dd req-eb74e6e1-4b0b-4e11-9766-27f6e57372fd service nova] Acquired lock "refresh_cache-ec571e3e-90e0-47d4-b1ae-98a356dc43f6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-5ba27468-53b6-4780-810a-b304c096d2dd req-eb74e6e1-4b0b-4e11-9766-27f6e57372fd service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Refreshing network info cache for port 96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lazy-loading 'flavor' on Instance uuid ec571e3e-90e0-47d4-b1ae-98a356dc43f6 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:50 user nova-compute[75813]: INFO nova.compute.manager [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Attaching volume 9192dfbe-5fc2-495f-947e-e7d284d4e769 to /dev/vdb
Nov 15 12:49:50 user nova-compute[75813]: DEBUG os_brick.utils [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[314dc441-6919-4f74-b1f4-7bc8c64eddec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[040530de-a505-4c43-95ee-34527a01bff8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fb02d0-f72d-4118-a00a-10014c8c2330]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7711fbd5-f4b7-4cb8-99af-8df62e6d7711]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-5ba27468-53b6-4780-810a-b304c096d2dd req-eb74e6e1-4b0b-4e11-9766-27f6e57372fd service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Updated VIF entry in instance network info cache for port 96d6bc55-a485-4bfe-8bc5-b6978bababb3. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-5ba27468-53b6-4780-810a-b304c096d2dd req-eb74e6e1-4b0b-4e11-9766-27f6e57372fd service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Updating instance_info_cache with network_info: [{"id": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "address": "fa:16:3e:b3:d6:37", "network": {"id": "ad54a03a-4017-4bdf-8b27-2fee2d038d2d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1945739865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec31cbd1cad4e7cb23e1fb4616b00c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d6bc55-a4", "ovs_interfaceid": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:49:50 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84e120d-c0c6-4cb2-a928-5132b0864ce5]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG os_brick.utils [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Updating existing volume attachment record: 9c0df99b-c3ca-4327-8966-4c05d685c14c {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:49:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5ba27468-53b6-4780-810a-b304c096d2dd req-eb74e6e1-4b0b-4e11-9766-27f6e57372fd service nova] Releasing lock "refresh_cache-ec571e3e-90e0-47d4-b1ae-98a356dc43f6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:49:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:49:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:49:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Instance spawned successfully.
Nov 15 12:49:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-f4488cbd-0f5d-4a0e-8ca8-f62a352dac35 req-1fa6fb86-d2f3-4cdf-9cec-0f82957c0abc service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Received event network-vif-plugged-89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f4488cbd-0f5d-4a0e-8ca8-f62a352dac35 req-1fa6fb86-d2f3-4cdf-9cec-0f82957c0abc service nova] Acquiring lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f4488cbd-0f5d-4a0e-8ca8-f62a352dac35 req-1fa6fb86-d2f3-4cdf-9cec-0f82957c0abc service nova] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f4488cbd-0f5d-4a0e-8ca8-f62a352dac35 req-1fa6fb86-d2f3-4cdf-9cec-0f82957c0abc service nova] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-f4488cbd-0f5d-4a0e-8ca8-f62a352dac35 req-1fa6fb86-d2f3-4cdf-9cec-0f82957c0abc service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] No waiting events found dispatching network-vif-plugged-89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:49:52 user nova-compute[75813]: WARNING nova.compute.manager [req-f4488cbd-0f5d-4a0e-8ca8-f62a352dac35 req-1fa6fb86-d2f3-4cdf-9cec-0f82957c0abc service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Received unexpected event network-vif-plugged-89a522a0-b643-4aae-be18-487bc2d1da47 for instance with vm_state building and task_state spawning.
Nov 15 12:49:52 user nova-compute[75813]: INFO nova.compute.manager [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:49:52 user nova-compute[75813]: INFO nova.compute.manager [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Took 6.14 seconds to build instance.
Nov 15 12:49:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7c683f5b-966e-4bef-9d37-61ac936b1523 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.236s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-fbdc5643-6cd8-436a-a94d-b1db65adbf39 req-b292f86d-887c-4cbc-a2d1-331c776f249d service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Received event network-changed-7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-fbdc5643-6cd8-436a-a94d-b1db65adbf39 req-b292f86d-887c-4cbc-a2d1-331c776f249d service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Refreshing instance network info cache due to event network-changed-7e0f932c-2143-4699-baaf-cc65b5552c15. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fbdc5643-6cd8-436a-a94d-b1db65adbf39 req-b292f86d-887c-4cbc-a2d1-331c776f249d service nova] Acquiring lock "refresh_cache-43f11322-00e7-472d-91f9-48ac1b16f33c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fbdc5643-6cd8-436a-a94d-b1db65adbf39 req-b292f86d-887c-4cbc-a2d1-331c776f249d service nova] Acquired lock "refresh_cache-43f11322-00e7-472d-91f9-48ac1b16f33c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.network.neutron [req-fbdc5643-6cd8-436a-a94d-b1db65adbf39 req-b292f86d-887c-4cbc-a2d1-331c776f249d service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Refreshing network info cache for port 7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.network.neutron [req-fbdc5643-6cd8-436a-a94d-b1db65adbf39 req-b292f86d-887c-4cbc-a2d1-331c776f249d service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Updated VIF entry in instance network info cache for port 7e0f932c-2143-4699-baaf-cc65b5552c15. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG nova.network.neutron [req-fbdc5643-6cd8-436a-a94d-b1db65adbf39 req-b292f86d-887c-4cbc-a2d1-331c776f249d service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Updating instance_info_cache with network_info: [{"id": "7e0f932c-2143-4699-baaf-cc65b5552c15", "address": "fa:16:3e:27:12:cc", "network": {"id": "a2536574-aea2-4d48-a3d5-65b37e440206", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1465242308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43902590da14baa9aa3dd80ad8ff4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0f932c-21", "ovs_interfaceid": "7e0f932c-2143-4699-baaf-cc65b5552c15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fbdc5643-6cd8-436a-a94d-b1db65adbf39 req-b292f86d-887c-4cbc-a2d1-331c776f249d service nova] Releasing lock "refresh_cache-43f11322-00e7-472d-91f9-48ac1b16f33c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:49:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "43f11322-00e7-472d-91f9-48ac1b16f33c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lazy-loading 'flavor' on Instance uuid 43f11322-00e7-472d-91f9-48ac1b16f33c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "43f11322-00e7-472d-91f9-48ac1b16f33c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:55 user nova-compute[75813]: INFO nova.compute.manager [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Attaching volume 85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 to /dev/sdc
Nov 15 12:49:55 user nova-compute[75813]: DEBUG os_brick.utils [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c84e1e7-5691-436e-8a3a-593d96b0459d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[14befdef-346e-4eb8-bdf1-34531cb52a5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bd1dcf-8e7f-4a07-925a-e0db546ab14a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ee2751-1d8a-40d9-af65-6ee5d1c06a2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:49:55 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:49:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0892be88-1db7-49d9-907a-d54120d684e9]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG os_brick.utils [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:49:55 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Updating existing volume attachment record: a65ae1c0-1ec6-401b-8159-2827b230a3b5 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUyPjpSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:49:56 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:49:56 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:49:56 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[74518ea1-4387-493f-9c62-64755d6001ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:49:56 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b7b8bb-d41f-4a29-9365-dd8623074aee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769] added
Nov 15 12:49:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[738572bb-e31c-45a0-8ea7-a910bdfbf6cb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad142abf-f638-49bf-b895-43686d4bb023]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NUyPjpSa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NUyPjpSa" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb74808-5de1-422b-b814-6be5bf96bdde]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NUyPjpSa'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaf2e4d-21d6-4b10-b0ed-298853696c0e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d684d8-40fd-4a52-8b52-24d4724cdabf]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd9dc27-373b-4d0b-ba3a-2d5cbf4ece63 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd9dc27-373b-4d0b-ba3a-2d5cbf4ece63 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd9dc27-373b-4d0b-ba3a-2d5cbf4ece63 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[35976ab1-30af-47b4-9091-9cfa1a31153b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260]
Nov 15 12:49:56 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260] successful.
Nov 15 12:49:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf4be82-0e58-4e14-9dab-3d1ceb834245]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[083d7098-981d-4c9f-897b-870003c53515]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd9dc27-373b-4d0b-ba3a-2d5cbf4ece63 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd9dc27-373b-4d0b-ba3a-2d5cbf4ece63 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff3bd8e-1fdd-4f46-af8c-2704e529d413 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd9dc27-373b-4d0b-ba3a-2d5cbf4ece63 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:49:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[068c9c12-dbf8-4714-88b0-1cdf1a758340]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:49:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUyPjpSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:49:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:49:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26535386162633862', 'path': '/dev/sde'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:49:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535386162633862', 'path': '/dev/sde'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:49:57 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lazy-loading 'flavor' on Instance uuid ec571e3e-90e0-47d4-b1ae-98a356dc43f6 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:49:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:49:57 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:49:57 user nova-compute[75813]:   <source dev="/dev/sde"/>
Nov 15 12:49:57 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:49:57 user nova-compute[75813]:   <serial>9192dfbe-5fc2-495f-947e-e7d284d4e769</serial>
Nov 15 12:49:57 user nova-compute[75813]: </disk>
Nov 15 12:49:57 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] No VIF found with MAC fa:16:3e:b3:d6:37, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-70e465a7-55d5-4b49-b99f-1d20cf8ceb0b req-e62ae7fd-7b6e-412f-bfc2-bcf0c686c953 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Received event network-changed-2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-70e465a7-55d5-4b49-b99f-1d20cf8ceb0b req-e62ae7fd-7b6e-412f-bfc2-bcf0c686c953 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Refreshing instance network info cache due to event network-changed-2b17c39b-e529-4861-862a-a18d792319eb. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-70e465a7-55d5-4b49-b99f-1d20cf8ceb0b req-e62ae7fd-7b6e-412f-bfc2-bcf0c686c953 service nova] Acquiring lock "refresh_cache-0e47f02a-040d-422f-8847-40eb19df4073" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-70e465a7-55d5-4b49-b99f-1d20cf8ceb0b req-e62ae7fd-7b6e-412f-bfc2-bcf0c686c953 service nova] Acquired lock "refresh_cache-0e47f02a-040d-422f-8847-40eb19df4073" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG nova.network.neutron [req-70e465a7-55d5-4b49-b99f-1d20cf8ceb0b req-e62ae7fd-7b6e-412f-bfc2-bcf0c686c953 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Refreshing network info cache for port 2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c6d4b6c5-f43c-46ba-964e-2f14266cdf9d tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.147s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Acquiring lock "0e47f02a-040d-422f-8847-40eb19df4073" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "0e47f02a-040d-422f-8847-40eb19df4073" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG nova.objects.instance [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lazy-loading 'flavor' on Instance uuid 0e47f02a-040d-422f-8847-40eb19df4073 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:49:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "0e47f02a-040d-422f-8847-40eb19df4073" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG nova.network.neutron [req-70e465a7-55d5-4b49-b99f-1d20cf8ceb0b req-e62ae7fd-7b6e-412f-bfc2-bcf0c686c953 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Updated VIF entry in instance network info cache for port 2b17c39b-e529-4861-862a-a18d792319eb. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG nova.network.neutron [req-70e465a7-55d5-4b49-b99f-1d20cf8ceb0b req-e62ae7fd-7b6e-412f-bfc2-bcf0c686c953 service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Updating instance_info_cache with network_info: [{"id": "2b17c39b-e529-4861-862a-a18d792319eb", "address": "fa:16:3e:47:ff:47", "network": {"id": "21c21876-9fad-43b9-aabf-195b5bcb7a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-507934887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87366b2817cb490484846f30d737bcba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b17c39b-e5", "ovs_interfaceid": "2b17c39b-e529-4861-862a-a18d792319eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Acquiring lock "0e47f02a-040d-422f-8847-40eb19df4073" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "0e47f02a-040d-422f-8847-40eb19df4073" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:49:59 user nova-compute[75813]: INFO nova.compute.manager [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Attaching volume ad0a13ab-5887-4003-9fc7-3a5b417b0c72 to /dev/vdb
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-70e465a7-55d5-4b49-b99f-1d20cf8ceb0b req-e62ae7fd-7b6e-412f-bfc2-bcf0c686c953 service nova] Releasing lock "refresh_cache-0e47f02a-040d-422f-8847-40eb19df4073" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG os_brick.utils [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55cd95c-fd1a-4feb-9707-e4386e7b1f8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d435da2f-0b98-4207-a79e-0c1b3600a872]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e03e285-61dc-4e76-81d3-3c26df7bca20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb30ddb-1482-4676-8ebf-78920f02416b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:49:59 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:49:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1770a45b-c713-45b3-870f-93c64804b587]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG os_brick.utils [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:49:59 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Updating existing volume attachment record: fc020b88-8f9c-496b-a3ac-669c87232599 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG os_brick.utils [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac6ed9d-6e38-48aa-b0e1-a4ef8f7c6f43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce7e515-fb50-4915-ba65-fd40e7546660]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cced1d8-bb3c-4fdc-a1b0-7ba727a37c43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8190d30-5b3a-46dd-9067-4f7d63da2b0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:50:00 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:50:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f156511-465b-4b12-ae51-41d8af584e13]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:50:00 user nova-compute[75813]: DEBUG os_brick.utils [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:50:00 user nova-compute[75813]: INFO nova.compute.manager [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Swapping volume 9192dfbe-5fc2-495f-947e-e7d284d4e769 for 7abbcb61-2ff7-450c-ad97-2686de23ff2b
Nov 15 12:50:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfmDtMBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:50:01 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:01 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:01 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b413073-2c03-41cc-9054-c5a889687fee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:50:01 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9150acf6-82a6-4969-9e67-7477884ab0ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0] added
Nov 15 12:50:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad2d3ed-fc11-4a41-92ff-c71bb328655e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b292fd-9bed-4653-bbd3-c390b21703a7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfmDtMBc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfmDtMBc" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1092e86e-5a1a-4a9f-bebb-f5bf708a1d50]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zfmDtMBc'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8f9ca5-911c-4b43-9a1b-8bdb5809d216]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1cf01d-d825-4437-bd78-bf8cd371c7da]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:01 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:01 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3f8a4a-0cab-42d3-b14c-3eeefce61170]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0, portal: 172.16.0.220,3260]
Nov 15 12:50:01 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0, portal: 172.16.0.220,3260] successful.
Nov 15 12:50:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b404c8f-1c94-4484-984e-6ec2f659a42e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1942fe4b-7965-4a22-a6e7-8d304f07f297]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:01 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:01 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:01 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:01 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bcd243-03c6-4667-9217-e94d7ad08807]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:50:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfmDtMBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:50:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23736323131646536', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:50:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736323131646536', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:50:02 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lazy-loading 'flavor' on Instance uuid 43f11322-00e7-472d-91f9-48ac1b16f33c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:50:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:50:02 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:50:02 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 12:50:02 user nova-compute[75813]:   <target dev="sdc" bus="scsi"/>
Nov 15 12:50:02 user nova-compute[75813]:   <serial>85f793a5-4d7d-49e5-9bff-05cbba7a2bd0</serial>
Nov 15 12:50:02 user nova-compute[75813]:   <address type="drive" controller="0" unit="2"/>
Nov 15 12:50:02 user nova-compute[75813]: </disk>
Nov 15 12:50:02 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:50:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] No BDM found with device name sda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:50:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:50:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:50:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] No VIF found with MAC fa:16:3e:27:12:cc, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:50:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d38f9785-56eb-4927-8310-59607b8762a5 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.837s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "43f11322-00e7-472d-91f9-48ac1b16f33c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:03 user nova-compute[75813]: INFO nova.compute.manager [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Detaching volume 85f793a5-4d7d-49e5-9bff-05cbba7a2bd0
Nov 15 12:50:03 user nova-compute[75813]: INFO nova.virt.block_device [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Attempting to driver detach volume 85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 from mountpoint /dev/sdc
Nov 15 12:50:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Attempting to detach device sdc from instance 43f11322-00e7-472d-91f9-48ac1b16f33c from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:50:04 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:50:04 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 12:50:04 user nova-compute[75813]:   <target dev="sdc" bus="scsi"/>
Nov 15 12:50:04 user nova-compute[75813]:   <serial>85f793a5-4d7d-49e5-9bff-05cbba7a2bd0</serial>
Nov 15 12:50:04 user nova-compute[75813]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 12:50:04 user nova-compute[75813]: </disk>
Nov 15 12:50:04 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:50:04 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Successfully detached device sdc from instance 43f11322-00e7-472d-91f9-48ac1b16f33c from the persistent domain config.
Nov 15 12:50:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 43f11322-00e7-472d-91f9-48ac1b16f33c from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:50:04 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:50:04 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 12:50:04 user nova-compute[75813]:   <target dev="sdc" bus="scsi"/>
Nov 15 12:50:04 user nova-compute[75813]:   <serial>85f793a5-4d7d-49e5-9bff-05cbba7a2bd0</serial>
Nov 15 12:50:04 user nova-compute[75813]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 12:50:04 user nova-compute[75813]: </disk>
Nov 15 12:50:04 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 43f11322-00e7-472d-91f9-48ac1b16f33c {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoyFIHin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:50:04 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:04 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:04 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2ee5df-ad1c-4d27-9013-16200321e2c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:50:04 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[634249ab-9eda-40db-a616-648f6984ba80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72] added
Nov 15 12:50:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7bc16c-5968-4888-80e5-88f62483ac7b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5588077-7b42-44a8-993d-5a183d1aa58f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoyFIHin {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoyFIHin" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe61f799-9622-4f37-b6cc-cd1237e51d7b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoyFIHin'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf5987f-ea0c-4029-b281-adf2e9228f28]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ece6a85-77ea-407e-b04b-5b634bc04620]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:04 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:04 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:04 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:04 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[342e904f-4ea2-4f0b-bd4f-e55f8479eb9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72, portal: 172.16.0.220,3260]
Nov 15 12:50:04 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72, portal: 172.16.0.220,3260] successful.
Nov 15 12:50:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[20403139-792e-4b7d-ac17-b3ff250eccb6]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d426d9-42f2-45b0-8ece-808e360a93d5]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:05 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:05 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:05 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:05 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:05 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:05 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:05 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:05 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de85ec3-6238-4c45-9a97-41b8b4f0d7a4]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcwhHEPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ec571e3e-90e0-47d4-b1ae-98a356dc43f6', 'attached_at': '', 'detached_at': '', 'volume_id': '7abbcb61-2ff7-450c-ad97-2686de23ff2b', 'serial': '7abbcb61-2ff7-450c-ad97-2686de23ff2b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUyPjpSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ec571e3e-90e0-47d4-b1ae-98a356dc43f6', 'attached_at': '', 'detached_at': '', 'volume_id': '9192dfbe-5fc2-495f-947e-e7d284d4e769', 'serial'} {{(pid=75813) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:50:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcwhHEPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:50:05 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoyFIHin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23563316133306265', 'path': '/dev/sdd'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563316133306265', 'path': '/dev/sdd'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.468s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:06 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:06 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG nova.objects.instance [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lazy-loading 'flavor' on Instance uuid 0e47f02a-040d-422f-8847-40eb19df4073 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78a606d-0890-45f8-aa99-51a14431a875]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:50:06 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 12:50:06 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:50:06 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 12:50:06 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:50:06 user nova-compute[75813]:   <serial>ad0a13ab-5887-4003-9fc7-3a5b417b0c72</serial>
Nov 15 12:50:06 user nova-compute[75813]: </disk>
Nov 15 12:50:06 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba00fb01-34ef-40e9-9652-c974bae0a1df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b] added
Nov 15 12:50:06 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1657f55-2322-47b5-bf72-a651bf17059d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[910032c4-8740-4e73-9f61-de2d592e008b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcwhHEPX {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcwhHEPX" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70cb82c-5010-412b-962b-3bd9b27c5b94]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JcwhHEPX'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8dafd1-7b13-49a7-90b8-97d8d871c4f0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae55140-1998-4df5-b69c-5ec26579f20d]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cab4c95-24e4-41ec-9f4d-a02b6c7310cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b, portal: 172.16.0.220,3260]
Nov 15 12:50:06 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b, portal: 172.16.0.220,3260] successful.
Nov 15 12:50:06 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ad1ca8-e5ee-4eaa-8ee9-638e4c293b47]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2966d60c-d84f-4d69-bf01-9ff68b7a7efc]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:06 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:06 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:06 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[229404bd-d80d-4c30-9d0f-b192d87ed36b]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] No VIF found with MAC fa:16:3e:47:ff:47, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-132913bf-b9c6-412a-8102-d02e40adca1a tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "0e47f02a-040d-422f-8847-40eb19df4073" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.518s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eabe9e75-9581-4a11-983c-2680e3fa78e6 tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] volume_snapshot_create: create_info: {'snapshot_id': '1a09fdab-d2e1-43da-b8fd-2e10e044c550', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75813) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eabe9e75-9581-4a11-983c-2680e3fa78e6 tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] snap xml: <domainsnapshot>
Nov 15 12:50:06 user nova-compute[75813]:   <disks>
Nov 15 12:50:06 user nova-compute[75813]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 15 12:50:06 user nova-compute[75813]:       <source file="/dev/new_file"/>
Nov 15 12:50:06 user nova-compute[75813]:     </disk>
Nov 15 12:50:06 user nova-compute[75813]:     <disk name="vda" snapshot="no"/>
Nov 15 12:50:06 user nova-compute[75813]:   </disks>
Nov 15 12:50:06 user nova-compute[75813]: </domainsnapshot>
Nov 15 12:50:06 user nova-compute[75813]:  {{(pid=75813) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 12:50:06 user nova-compute[75813]: DEBUG nova.objects.instance [None req-eabe9e75-9581-4a11-983c-2680e3fa78e6 tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] Lazy-loading 'system_metadata' on Instance uuid 0e47f02a-040d-422f-8847-40eb19df4073 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:50:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a51d9e6c-2dec-4521-8340-04bbeee4787a tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] volume_snapshot_delete: delete_info: {'volume_id': 'ad0a13ab-5887-4003-9fc7-3a5b417b0c72'} {{(pid=75813) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [None req-a51d9e6c-2dec-4521-8340-04bbeee4787a tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Traceback (most recent call last):
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     if delete_info['type'] != 'qcow2':
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073] KeyError: 'type'
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073] 
Nov 15 12:50:07 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-eabe9e75-9581-4a11-983c-2680e3fa78e6 tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [None req-eabe9e75-9581-4a11-983c-2680e3fa78e6 tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Traceback (most recent call last):
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     rv = execute(f, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     six.reraise(c, e, tb)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     raise value
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     rv = meth(*args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073] 
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [None req-eabe9e75-9581-4a11-983c-2680e3fa78e6 tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Traceback (most recent call last):
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     self._volume_snapshot_create(context, instance, guest,
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     rv = execute(f, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     six.reraise(c, e, tb)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     raise value
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     rv = meth(*args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [instance: 0e47f02a-040d-422f-8847-40eb19df4073] 
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [None req-a51d9e6c-2dec-4521-8340-04bbeee4787a tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver 
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver 
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-fcb9d3d0-df39-4913-837f-007fb946911f)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver 
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver 
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver 
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server [None req-a51d9e6c-2dec-4521-8340-04bbeee4787a tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] Exception during message handling: KeyError: 'type'
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server 
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver [None req-eabe9e75-9581-4a11-983c-2680e3fa78e6 tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 1a09fdab-d2e1-43da-b8fd-2e10e044c550 could not be found.
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver 
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver 
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 1a09fdab-d2e1-43da-b8fd-2e10e044c550 could not be found. (HTTP 404) (Request-ID: req-c7a3a921-8142-4578-83f9-aef0e5e49aeb)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver 
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver 
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 1a09fdab-d2e1-43da-b8fd-2e10e044c550 could not be found.
Nov 15 12:50:07 user nova-compute[75813]: ERROR nova.virt.libvirt.driver 
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server [None req-eabe9e75-9581-4a11-983c-2680e3fa78e6 tempest-VolumesAssistedSnapshotsTest-984450680 tempest-VolumesAssistedSnapshotsTest-984450680-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 12:50:07 user nova-compute[75813]: ERROR oslo_messaging.rpc.server 
Nov 15 12:50:07 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:50:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcwhHEPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:50:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] <== connect_volume: return (1764ms) {'type': 'block', 'scsi_wwn': '23865663362356239', 'path': '/dev/sdf'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:50:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865663362356239', 'path': '/dev/sdf'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:50:07 user nova-compute[75813]: DEBUG nova.objects.instance [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lazy-loading 'flavor' on Instance uuid ec571e3e-90e0-47d4-b1ae-98a356dc43f6 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:50:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Acquiring lock "0e47f02a-040d-422f-8847-40eb19df4073" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "0e47f02a-040d-422f-8847-40eb19df4073" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:07 user nova-compute[75813]: INFO nova.compute.manager [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Detaching volume ad0a13ab-5887-4003-9fc7-3a5b417b0c72
Nov 15 12:50:07 user nova-compute[75813]: INFO nova.virt.block_device [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Attempting to driver detach volume ad0a13ab-5887-4003-9fc7-3a5b417b0c72 from mountpoint /dev/vdb
Nov 15 12:50:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Attempting to detach device vdb from instance 0e47f02a-040d-422f-8847-40eb19df4073 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:50:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 12:50:07 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:50:07 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 12:50:07 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:50:07 user nova-compute[75813]:   <serial>ad0a13ab-5887-4003-9fc7-3a5b417b0c72</serial>
Nov 15 12:50:07 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:50:07 user nova-compute[75813]: </disk>
Nov 15 12:50:07 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:50:07 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Successfully detached device vdb from instance 0e47f02a-040d-422f-8847-40eb19df4073 from the persistent domain config.
Nov 15 12:50:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e47f02a-040d-422f-8847-40eb19df4073 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:50:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 12:50:07 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:50:07 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 12:50:07 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:50:07 user nova-compute[75813]:   <serial>ad0a13ab-5887-4003-9fc7-3a5b417b0c72</serial>
Nov 15 12:50:07 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:50:07 user nova-compute[75813]: </disk>
Nov 15 12:50:07 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:50:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e47f02a-040d-422f-8847-40eb19df4073 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:50:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 158334976 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 334495744 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 407896064 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 590348288 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:10 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 739246080 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:10 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 899678208 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 1061158912 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:50:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUyPjpSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:50:11 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b15eca-7055-48ee-b9fc-0b3adaa81bbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:50:12 user nova-compute[75813]: No targets found.
Nov 15 12:50:12 user nova-compute[75813]: iSNS:
Nov 15 12:50:12 user nova-compute[75813]: No targets found.
Nov 15 12:50:12 user nova-compute[75813]: STATIC:
Nov 15 12:50:12 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b
Nov 15 12:50:12 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:12 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:12 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769
Nov 15 12:50:12 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:12 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:12 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357
Nov 15 12:50:12 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:12 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:12 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72
Nov 15 12:50:12 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:12 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:12 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0
Nov 15 12:50:12 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:12 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:12 user nova-compute[75813]: FIRMWARE:
Nov 15 12:50:12 user nova-compute[75813]: No targets found.
Nov 15 12:50:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:50:12 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:50:12 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3dafb7-1aeb-46e0-8107-1aec7a1c50e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeed587-8b69-4242-83b3-3dbd746acfec]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:12 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:12 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:12 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:12 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:12 user nova-compute[75813]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:12 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:12 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:12 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55504f9fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769'): ({'sde'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Removing single pathed devices sde {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da0531a-e83d-4102-a7b9-f248be15b48c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9666372-fcae-415d-b8b7-c67588ec88d1]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Flushing IO for device /dev/sde {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8d7864-d0d9-4dd5-88c3-2b83787508f7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4614602-a196-461e-a4b3-ca53cc23104f]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ffdfee-787d-4e70-961a-cc0a78fdf346]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef935b2-b113-422a-bb3a-6bf6e7548201]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260]
Nov 15 12:50:12 user nova-compute[75813]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260] successful.
Nov 15 12:50:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c99dd84-8c39-410d-ad41-a8c02199aefe]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] <== disconnect_volume: return (321ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcwhHEPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ec571e3e-90e0-47d4-b1ae-98a356dc43f6', 'attached_at': '', 'detached_at': '', 'volume_id': '7abbcb61-2ff7-450c-ad97-2686de23ff2b', 'serial'} {{(pid=75813) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 12:50:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] swap_volume: removing Cinder connection for volume 9192dfbe-5fc2-495f-947e-e7d284d4e769 {{(pid=75813) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 12:50:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] swap_volume: Updating volume 9192dfbe-5fc2-495f-947e-e7d284d4e769 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "JcwhHEPX", "auth_password": "ZV962tCFOwevmo", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "7abbcb61-2ff7-450c-ad97-2686de23ff2b"}, "status": "reserved", "instance": "ec571e3e-90e0-47d4-b1ae-98a356dc43f6", "attached_at": "", "detached_at": "", "volume_id": "7abbcb61-2ff7-450c-ad97-2686de23ff2b", "serial": "7abbcb61-2ff7-450c-ad97-2686de23ff2b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7abbcb61-2ff7-450c-ad97-2686de23ff2b', 'no_device': None, 'attachment_id': '22b7bb61-a7b8-41d6-ab7c-6e5bb65727bb'} {{(pid=75813) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 12:50:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-543961e2-3340-4edd-939b-e183c9ab8fbd tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.123s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG os_brick.utils [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7787b2fb-8965-4501-ab65-65832003ea21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac55c8fe-185d-47e7-9aba-cec3826e88b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5846cd55-c2bd-44cf-b079-b686bad5e78f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc2b489-8259-4ed1-94e4-bbdfd2b95907]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:50:14 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:50:14 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bc638e-2f44-4fee-a80f-27d53c89427f]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:50:14 user nova-compute[75813]: DEBUG os_brick.utils [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:50:15 user nova-compute[75813]: INFO nova.compute.manager [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Swapping volume 7abbcb61-2ff7-450c-ad97-2686de23ff2b for 9192dfbe-5fc2-495f-947e-e7d284d4e769
Nov 15 12:50:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUyPjpSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ec571e3e-90e0-47d4-b1ae-98a356dc43f6', 'attached_at': '', 'detached_at': '', 'volume_id': '9192dfbe-5fc2-495f-947e-e7d284d4e769', 'serial': '9192dfbe-5fc2-495f-947e-e7d284d4e769'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcwhHEPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '7abbcb61-2ff7-450c-ad97-2686de23ff2b'}, 'status': 'reserved', 'instance': 'ec571e3e-90e0-47d4-b1ae-98a356dc43f6', 'attached_at': '', 'detached_at': '', 'volume_id': '7abbcb61-2ff7-450c-ad97-2686de23ff2b', 'serial'} {{(pid=75813) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUyPjpSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:50:19 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:19 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:19 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:50:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5251f7e3-e6b3-4867-9100-47bd7912ca5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:50:19 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20cb33e-da7d-44c5-9405-3289f88df1d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769] added
Nov 15 12:50:19 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f82e7fd-7896-43f8-830d-19cb78812156]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e062a7-06d1-42af-8fcc-1ad603905a3f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NUyPjpSa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NUyPjpSa" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff45e61-da81-4be5-94de-fba479b29eea]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NUyPjpSa'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfb0f32-c473-44aa-a9df-2fbe01684d62]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[871f1e8b-1e13-4bdb-97df-63b3f413b94c]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Acquiring lock "3d4122cd-dafe-4dd0-b7e6-38125513807f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Acquiring lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:20 user nova-compute[75813]: INFO nova.compute.manager [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Terminating instance
Nov 15 12:50:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[67de2239-da87-4003-b410-bbdf0857bacf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260]
Nov 15 12:50:20 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260] successful.
Nov 15 12:50:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55ec9d9-239e-4f62-8b8e-8e958982fea8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b214fe1-c5ce-409a-9d82-7ee670b88daa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:20 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df927a2-07ee-4d25-842d-c33bf6fa7917]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUyPjpSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-e914ccb3-9902-42e7-9bdf-8b5fd06576e3 req-d80605a2-dabe-4eec-9264-3997f3d1570f service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Received event network-vif-unplugged-106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e914ccb3-9902-42e7-9bdf-8b5fd06576e3 req-d80605a2-dabe-4eec-9264-3997f3d1570f service nova] Acquiring lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e914ccb3-9902-42e7-9bdf-8b5fd06576e3 req-d80605a2-dabe-4eec-9264-3997f3d1570f service nova] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e914ccb3-9902-42e7-9bdf-8b5fd06576e3 req-d80605a2-dabe-4eec-9264-3997f3d1570f service nova] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-e914ccb3-9902-42e7-9bdf-8b5fd06576e3 req-d80605a2-dabe-4eec-9264-3997f3d1570f service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] No waiting events found dispatching network-vif-unplugged-106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-e914ccb3-9902-42e7-9bdf-8b5fd06576e3 req-d80605a2-dabe-4eec-9264-3997f3d1570f service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Received event network-vif-unplugged-106d6039-b2e2-457e-9a5a-745dde3e597a for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:50:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Instance destroyed successfully.
Nov 15 12:50:20 user nova-compute[75813]: DEBUG nova.objects.instance [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lazy-loading 'resources' on Instance uuid 3d4122cd-dafe-4dd0-b7e6-38125513807f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-154413265',display_name='tempest-VolumesActionsTest-instance-154413265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-154413265',id=8,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:48:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='803a0a98f55d4dac988168491dda9c29',ramdisk_id='',reservation_id='r-uy50wa2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-381635204',owner_user_name='tempest-VolumesActionsTest-381635204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:48:32Z,user_data=None,user_id='2cc425e9972b476ead35f79802893b17',uuid=3d4122cd-dafe-4dd0-b7e6-38125513807f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "106d6039-b2e2-457e-9a5a-745dde3e597a", "address": "fa:16:3e:bd:fd:88", "network": {"id": "18a5847d-f657-4757-a18b-d654ec9617ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-802389147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "803a0a98f55d4dac988168491dda9c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106d6039-b2", "ovs_interfaceid": "106d6039-b2e2-457e-9a5a-745dde3e597a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Converting VIF {"id": "106d6039-b2e2-457e-9a5a-745dde3e597a", "address": "fa:16:3e:bd:fd:88", "network": {"id": "18a5847d-f657-4757-a18b-d654ec9617ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-802389147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "803a0a98f55d4dac988168491dda9c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106d6039-b2", "ovs_interfaceid": "106d6039-b2e2-457e-9a5a-745dde3e597a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fd:88,bridge_name='br-int',has_traffic_filtering=True,id=106d6039-b2e2-457e-9a5a-745dde3e597a,network=Network(18a5847d-f657-4757-a18b-d654ec9617ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106d6039-b2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG os_vif [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fd:88,bridge_name='br-int',has_traffic_filtering=True,id=106d6039-b2e2-457e-9a5a-745dde3e597a,network=Network(18a5847d-f657-4757-a18b-d654ec9617ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106d6039-b2') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap106d6039-b2, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=121fa24e-5a97-4bf1-b16a-ba70d679b3d2) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:20 user nova-compute[75813]: INFO os_vif [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fd:88,bridge_name='br-int',has_traffic_filtering=True,id=106d6039-b2e2-457e-9a5a-745dde3e597a,network=Network(18a5847d-f657-4757-a18b-d654ec9617ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106d6039-b2')
Nov 15 12:50:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Deleting instance files /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f_del
Nov 15 12:50:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Deletion of /opt/stack/data/nova/instances/3d4122cd-dafe-4dd0-b7e6-38125513807f_del complete
Nov 15 12:50:21 user nova-compute[75813]: INFO nova.compute.manager [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 15 12:50:21 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:50:21 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:50:21 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:50:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26535386162633862', 'path': '/dev/sde'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:50:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535386162633862', 'path': '/dev/sde'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:50:21 user nova-compute[75813]: DEBUG nova.objects.instance [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lazy-loading 'flavor' on Instance uuid ec571e3e-90e0-47d4-b1ae-98a356dc43f6 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:50:21 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:50:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:21 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Took 0.65 seconds to deallocate network for instance.
Nov 15 12:50:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:22 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:50:22 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:50:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 190840832 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:22 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Deleted allocations for instance 3d4122cd-dafe-4dd0-b7e6-38125513807f
Nov 15 12:50:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-41ce848d-4152-48ad-b451-f6ae4edb1853 tempest-VolumesActionsTest-381635204 tempest-VolumesActionsTest-381635204-project-member] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.309s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-56b3aa68-b2eb-461d-bb18-8825ec44fd70 req-3a0fa5a3-20d1-4dd0-9b4e-acc177f752c8 service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Received event network-vif-plugged-106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:50:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-56b3aa68-b2eb-461d-bb18-8825ec44fd70 req-3a0fa5a3-20d1-4dd0-9b4e-acc177f752c8 service nova] Acquiring lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-56b3aa68-b2eb-461d-bb18-8825ec44fd70 req-3a0fa5a3-20d1-4dd0-9b4e-acc177f752c8 service nova] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-56b3aa68-b2eb-461d-bb18-8825ec44fd70 req-3a0fa5a3-20d1-4dd0-9b4e-acc177f752c8 service nova] Lock "3d4122cd-dafe-4dd0-b7e6-38125513807f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-56b3aa68-b2eb-461d-bb18-8825ec44fd70 req-3a0fa5a3-20d1-4dd0-9b4e-acc177f752c8 service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] No waiting events found dispatching network-vif-plugged-106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:50:22 user nova-compute[75813]: WARNING nova.compute.manager [req-56b3aa68-b2eb-461d-bb18-8825ec44fd70 req-3a0fa5a3-20d1-4dd0-9b4e-acc177f752c8 service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Received unexpected event network-vif-plugged-106d6039-b2e2-457e-9a5a-745dde3e597a for instance with vm_state deleted and task_state None.
Nov 15 12:50:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-56b3aa68-b2eb-461d-bb18-8825ec44fd70 req-3a0fa5a3-20d1-4dd0-9b4e-acc177f752c8 service nova] [instance: 3d4122cd-dafe-4dd0-b7e6-38125513807f] Received event network-vif-deleted-106d6039-b2e2-457e-9a5a-745dde3e597a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:50:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 333447168 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 506462208 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 701497344 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 890241024 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:24 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 43f11322-00e7-472d-91f9-48ac1b16f33c is timed out.
Nov 15 12:50:24 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Successfully detached device sdc from instance 43f11322-00e7-472d-91f9-48ac1b16f33c from the live domain config.
Nov 15 12:50:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfmDtMBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:50:24 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c9a953-d5b5-4bb1-9305-b8bd0b13cb46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:50:24 user nova-compute[75813]: No targets found.
Nov 15 12:50:24 user nova-compute[75813]: iSNS:
Nov 15 12:50:24 user nova-compute[75813]: No targets found.
Nov 15 12:50:24 user nova-compute[75813]: STATIC:
Nov 15 12:50:24 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b
Nov 15 12:50:24 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:24 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:24 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769
Nov 15 12:50:24 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:24 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:24 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357
Nov 15 12:50:24 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:24 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:24 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72
Nov 15 12:50:24 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:24 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:24 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0
Nov 15 12:50:24 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:24 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:24 user nova-compute[75813]: FIRMWARE:
Nov 15 12:50:24 user nova-compute[75813]: No targets found.
Nov 15 12:50:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:50:24 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:50:24 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ba1c8c-3b60-47b0-b02f-d0f3399a49fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafe192f-24ae-4fcf-8cfb-8d9fece85300]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:24 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:24 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:24 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:24 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:24 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:24 user nova-compute[75813]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 (non-flash)
Nov 15 12:50:24 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:24 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550473a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0'): ({'sdc'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Removing single pathed devices sdc {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f6b1d7-dfe8-4d0c-9835-164ba355e5d4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d03dd5-04b5-4635-88b5-1cb910f5b9bd]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Flushing IO for device /dev/sdc {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e252643-0666-42aa-9eeb-45c98796a0d7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 1005584384 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37c8712-1f1b-4429-9b7d-a650ea1cab8e]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bfa9ef-86be-4942-898f-13f9a67012fb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca46dfa9-c3e5-475d-99d7-014c3ccdb474]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0, portal: 172.16.0.220,3260]
Nov 15 12:50:24 user nova-compute[75813]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0, portal: 172.16.0.220,3260] successful.
Nov 15 12:50:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f793a5-4d7d-49e5-9bff-05cbba7a2bd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6838eec5-cbcc-41a8-bf61-d4b87dae62d2]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] <== disconnect_volume: return (341ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:50:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcwhHEPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '7abbcb61-2ff7-450c-ad97-2686de23ff2b'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:50:25 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c73ae4-3d30-416e-be29-762c2e8a5404]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:50:25 user nova-compute[75813]: No targets found.
Nov 15 12:50:25 user nova-compute[75813]: iSNS:
Nov 15 12:50:25 user nova-compute[75813]: No targets found.
Nov 15 12:50:25 user nova-compute[75813]: STATIC:
Nov 15 12:50:25 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b
Nov 15 12:50:25 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:25 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:25 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769
Nov 15 12:50:25 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:25 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:25 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357
Nov 15 12:50:25 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:25 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:25 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72
Nov 15 12:50:25 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:25 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:25 user nova-compute[75813]: FIRMWARE:
Nov 15 12:50:25 user nova-compute[75813]: No targets found.
Nov 15 12:50:25 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:50:25 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:50:25 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[017be4dd-bc86-4eaf-bc80-c2c8970658b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c8ad77-7b72-4135-b255-8957d50c6b05]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:25 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:25 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:25 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:25 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:25 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:25 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:25 user nova-compute[75813]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b (non-flash)
Nov 15 12:50:25 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555008a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b'): ({'sdf'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Removing single pathed devices sdf {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dad6d4f-1673-4a32-89a3-3971ebe191ac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[42183091-0812-4f7c-a8b8-217b0e16abf0]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Flushing IO for device /dev/sdf {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83a0460-3633-4cb9-9633-2cbe19c0c8b1]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0c3c25-62cb-4895-8289-9959d215cd1f]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1698c7-2538-4ae4-ac84-eb4ac8f7f258]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[249e1410-c9c1-4ac6-bf5a-777ba14690ca]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b, portal: 172.16.0.220,3260]
Nov 15 12:50:25 user nova-compute[75813]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b, portal: 172.16.0.220,3260] successful.
Nov 15 12:50:25 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7abbcb61-2ff7-450c-ad97-2686de23ff2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e5f444-f1c2-4067-9442-d9ecce08ac11]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] <== disconnect_volume: return (317ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG nova.objects.instance [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lazy-loading 'flavor' on Instance uuid 43f11322-00e7-472d-91f9-48ac1b16f33c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e70f54d3-db3e-4a35-82cf-74ea8af22d74 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.937s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG nova.compute.manager [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUyPjpSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ec571e3e-90e0-47d4-b1ae-98a356dc43f6', 'attached_at': '', 'detached_at': '', 'volume_id': '9192dfbe-5fc2-495f-947e-e7d284d4e769', 'serial'} {{(pid=75813) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG nova.compute.manager [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] swap_volume: removing Cinder connection for volume 7abbcb61-2ff7-450c-ad97-2686de23ff2b {{(pid=75813) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 12:50:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:26 user nova-compute[75813]: DEBUG nova.compute.manager [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] swap_volume: Updating volume 7abbcb61-2ff7-450c-ad97-2686de23ff2b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "NUyPjpSa", "auth_password": "em0nPMacGwbko5", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "9192dfbe-5fc2-495f-947e-e7d284d4e769"}, "status": "reserved", "instance": "ec571e3e-90e0-47d4-b1ae-98a356dc43f6", "attached_at": "", "detached_at": "", "volume_id": "9192dfbe-5fc2-495f-947e-e7d284d4e769", "serial": "9192dfbe-5fc2-495f-947e-e7d284d4e769"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9192dfbe-5fc2-495f-947e-e7d284d4e769', 'no_device': None, 'attachment_id': '289f887b-868b-44eb-b98d-3bec874a04e0'} {{(pid=75813) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 12:50:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-505d4002-3ed6-4332-843d-1999ade534ad tempest-TestVolumeSwap-222609152 tempest-TestVolumeSwap-222609152-project-admin] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.762s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "43f11322-00e7-472d-91f9-48ac1b16f33c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:26 user nova-compute[75813]: INFO nova.compute.manager [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Terminating instance
Nov 15 12:50:26 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:50:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:27 user nova-compute[75813]: INFO nova.compute.manager [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Detaching volume 9192dfbe-5fc2-495f-947e-e7d284d4e769
Nov 15 12:50:27 user nova-compute[75813]: INFO nova.virt.block_device [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Attempting to driver detach volume 9192dfbe-5fc2-495f-947e-e7d284d4e769 from mountpoint /dev/vdb
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Attempting to detach device vdb from instance ec571e3e-90e0-47d4-b1ae-98a356dc43f6 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:50:27 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:50:27 user nova-compute[75813]:   <source dev="/dev/sde"/>
Nov 15 12:50:27 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:50:27 user nova-compute[75813]:   <serial>9192dfbe-5fc2-495f-947e-e7d284d4e769</serial>
Nov 15 12:50:27 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:50:27 user nova-compute[75813]: </disk>
Nov 15 12:50:27 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:50:27 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Successfully detached device vdb from instance ec571e3e-90e0-47d4-b1ae-98a356dc43f6 from the persistent domain config.
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec571e3e-90e0-47d4-b1ae-98a356dc43f6 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:50:27 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:50:27 user nova-compute[75813]:   <source dev="/dev/sde"/>
Nov 15 12:50:27 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:50:27 user nova-compute[75813]:   <serial>9192dfbe-5fc2-495f-947e-e7d284d4e769</serial>
Nov 15 12:50:27 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:50:27 user nova-compute[75813]: </disk>
Nov 15 12:50:27 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-0f15ea70-95a5-44d0-b2f8-96a5ffef3099 req-cbc011cb-cc06-4dcb-8fc1-be202004ab63 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Received event network-vif-unplugged-7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0f15ea70-95a5-44d0-b2f8-96a5ffef3099 req-cbc011cb-cc06-4dcb-8fc1-be202004ab63 service nova] Acquiring lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0f15ea70-95a5-44d0-b2f8-96a5ffef3099 req-cbc011cb-cc06-4dcb-8fc1-be202004ab63 service nova] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0f15ea70-95a5-44d0-b2f8-96a5ffef3099 req-cbc011cb-cc06-4dcb-8fc1-be202004ab63 service nova] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-0f15ea70-95a5-44d0-b2f8-96a5ffef3099 req-cbc011cb-cc06-4dcb-8fc1-be202004ab63 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] No waiting events found dispatching network-vif-unplugged-7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-0f15ea70-95a5-44d0-b2f8-96a5ffef3099 req-cbc011cb-cc06-4dcb-8fc1-be202004ab63 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Received event network-vif-unplugged-7e0f932c-2143-4699-baaf-cc65b5552c15 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec571e3e-90e0-47d4-b1ae-98a356dc43f6 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:50:27 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Instance destroyed successfully.
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lazy-loading 'resources' on Instance uuid 43f11322-00e7-472d-91f9-48ac1b16f33c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-971722182',display_name='tempest-AttachSCSIVolumeTestJSON-server-971722182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-971722182',id=6,image_ref='c731691c-b724-44ba-ae7f-945af1ab2bd0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyD1U+js/KIE/tzP+Id3Ue70ofRTOmqUTcvS9LLNzFAEbGR7zEGcjMin33pFJHrK5oBkq2Xo7Q6gJy27Zw/THeeXl8zN8ZSghnIRPECgXusoTwSdQIIIJEq+H/6pOAg7A==',key_name='tempest-keypair-1940531588',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:48:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f43902590da14baa9aa3dd80ad8ff4dc',ramdisk_id='',reservation_id='r-ekpex3r3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c731691c-b724-44ba-ae7f-945af1ab2bd0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-128383334',owner_user_name='tempest-AttachSCSIVolumeTestJSON-128383334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab1d5b225c31426d8b63983387245c17',uuid=43f11322-00e7-472d-91f9-48ac1b16f33c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e0f932c-2143-4699-baaf-cc65b5552c15", "address": "fa:16:3e:27:12:cc", "network": {"id": "a2536574-aea2-4d48-a3d5-65b37e440206", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1465242308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43902590da14baa9aa3dd80ad8ff4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0f932c-21", "ovs_interfaceid": "7e0f932c-2143-4699-baaf-cc65b5552c15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Converting VIF {"id": "7e0f932c-2143-4699-baaf-cc65b5552c15", "address": "fa:16:3e:27:12:cc", "network": {"id": "a2536574-aea2-4d48-a3d5-65b37e440206", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1465242308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43902590da14baa9aa3dd80ad8ff4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0f932c-21", "ovs_interfaceid": "7e0f932c-2143-4699-baaf-cc65b5552c15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:12:cc,bridge_name='br-int',has_traffic_filtering=True,id=7e0f932c-2143-4699-baaf-cc65b5552c15,network=Network(a2536574-aea2-4d48-a3d5-65b37e440206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0f932c-21') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG os_vif [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:12:cc,bridge_name='br-int',has_traffic_filtering=True,id=7e0f932c-2143-4699-baaf-cc65b5552c15,network=Network(a2536574-aea2-4d48-a3d5-65b37e440206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0f932c-21') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e0f932c-21, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93def695-7fe6-43e4-bc6d-3e07c14d87a2) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:50:27 user nova-compute[75813]: INFO os_vif [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:12:cc,bridge_name='br-int',has_traffic_filtering=True,id=7e0f932c-2143-4699-baaf-cc65b5552c15,network=Network(a2536574-aea2-4d48-a3d5-65b37e440206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0f932c-21')
Nov 15 12:50:27 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Deleting instance files /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c_del
Nov 15 12:50:27 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Deletion of /opt/stack/data/nova/instances/43f11322-00e7-472d-91f9-48ac1b16f33c_del complete
Nov 15 12:50:28 user nova-compute[75813]: INFO nova.compute.manager [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:50:28 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0e47f02a-040d-422f-8847-40eb19df4073 is timed out.
Nov 15 12:50:28 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Successfully detached device vdb from instance 0e47f02a-040d-422f-8847-40eb19df4073 from the live domain config.
Nov 15 12:50:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoyFIHin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:50:28 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b53465c-dfd2-436c-abd5-e4872df461f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:50:28 user nova-compute[75813]: No targets found.
Nov 15 12:50:28 user nova-compute[75813]: iSNS:
Nov 15 12:50:28 user nova-compute[75813]: No targets found.
Nov 15 12:50:28 user nova-compute[75813]: STATIC:
Nov 15 12:50:28 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769
Nov 15 12:50:28 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:28 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:28 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357
Nov 15 12:50:28 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:28 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:28 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72
Nov 15 12:50:28 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:28 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:28 user nova-compute[75813]: FIRMWARE:
Nov 15 12:50:28 user nova-compute[75813]: No targets found.
Nov 15 12:50:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:50:28 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:50:28 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[109217e6-9f06-4277-8e52-6949f9df1a02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d21f44-5d5c-4731-bd03-1498d9fe48a5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:28 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:28 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:28 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:28 user nova-compute[75813]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 (non-flash)
Nov 15 12:50:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f553079a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72'): ({'sdd'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Removing single pathed devices sdd {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19e8c6c-b838-41b2-bfef-2760e592c944]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c662f0e8-5ffc-486d-b5fd-d3ee396be783]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Flushing IO for device /dev/sdd {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e96c0-2f09-4c4d-9632-8df32eb5d9d5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1321b4e0-0b33-4491-97ad-8b0fb53473b0]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacc37ea-aef4-411b-8e4e-7b2a191a76f2]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb42aee-8786-481e-8384-34e0d1710d09]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72, portal: 172.16.0.220,3260]
Nov 15 12:50:28 user nova-compute[75813]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72, portal: 172.16.0.220,3260] successful.
Nov 15 12:50:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0a13ab-5887-4003-9fc7-3a5b417b0c72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba86d73e-1749-48bc-9891-c0c9745c311b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] <== disconnect_volume: return (331ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:50:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:50:29 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Took 1.15 seconds to deallocate network for instance.
Nov 15 12:50:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-6cd54485-1556-466a-ab41-dda7b3ebe05f req-610cf324-9417-4ba4-8cdf-60f59052cd27 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Received event network-vif-plugged-7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6cd54485-1556-466a-ab41-dda7b3ebe05f req-610cf324-9417-4ba4-8cdf-60f59052cd27 service nova] Acquiring lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6cd54485-1556-466a-ab41-dda7b3ebe05f req-610cf324-9417-4ba4-8cdf-60f59052cd27 service nova] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6cd54485-1556-466a-ab41-dda7b3ebe05f req-610cf324-9417-4ba4-8cdf-60f59052cd27 service nova] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-6cd54485-1556-466a-ab41-dda7b3ebe05f req-610cf324-9417-4ba4-8cdf-60f59052cd27 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] No waiting events found dispatching network-vif-plugged-7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:50:29 user nova-compute[75813]: WARNING nova.compute.manager [req-6cd54485-1556-466a-ab41-dda7b3ebe05f req-610cf324-9417-4ba4-8cdf-60f59052cd27 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Received unexpected event network-vif-plugged-7e0f932c-2143-4699-baaf-cc65b5552c15 for instance with vm_state deleted and task_state None.
Nov 15 12:50:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-6cd54485-1556-466a-ab41-dda7b3ebe05f req-610cf324-9417-4ba4-8cdf-60f59052cd27 service nova] [instance: 43f11322-00e7-472d-91f9-48ac1b16f33c] Received event network-vif-deleted-7e0f932c-2143-4699-baaf-cc65b5552c15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG nova.objects.instance [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lazy-loading 'flavor' on Instance uuid 0e47f02a-040d-422f-8847-40eb19df4073 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5126ab83-512f-4d49-acbf-2580d6ca971e tempest-VolumesAssistedSnapshotsTest-1531504012 tempest-VolumesAssistedSnapshotsTest-1531504012-project-admin] Lock "0e47f02a-040d-422f-8847-40eb19df4073" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.969s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:50:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:29 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Deleted allocations for instance 43f11322-00e7-472d-91f9-48ac1b16f33c
Nov 15 12:50:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c010968c-8cbb-418c-aaab-6e9d49a68680 tempest-AttachSCSIVolumeTestJSON-128383334 tempest-AttachSCSIVolumeTestJSON-128383334-project-member] Lock "43f11322-00e7-472d-91f9-48ac1b16f33c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.789s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Acquiring lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Acquiring lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:30 user nova-compute[75813]: INFO nova.compute.manager [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Terminating instance
Nov 15 12:50:30 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:50:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:31 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Instance destroyed successfully.
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lazy-loading 'resources' on Instance uuid 8384fa60-36fd-4ad1-b397-8bc9ab088f01 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-103586113',display_name='tempest-VolumesNegativeTest-instance-103586113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-103586113',id=9,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:48:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6a6313bfce446d1b2491e9bbbf11043',ramdisk_id='',reservation_id='r-4o746nou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1365718575',owner_user_name='tempest-VolumesNegativeTest-1365718575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:48:48Z,user_data=None,user_id='31e2016c3ddf462b82363f1ed707ae79',uuid=8384fa60-36fd-4ad1-b397-8bc9ab088f01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "address": "fa:16:3e:0f:f4:63", "network": {"id": "9ccfe082-59ac-4f3e-b645-e7515227e74a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "496b19c3bbca416b90a414b3d4c03a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e35e03f-9a", "ovs_interfaceid": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Converting VIF {"id": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "address": "fa:16:3e:0f:f4:63", "network": {"id": "9ccfe082-59ac-4f3e-b645-e7515227e74a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "496b19c3bbca416b90a414b3d4c03a3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e35e03f-9a", "ovs_interfaceid": "0e35e03f-9a71-4d0a-afe6-ec888446e45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f4:63,bridge_name='br-int',has_traffic_filtering=True,id=0e35e03f-9a71-4d0a-afe6-ec888446e45c,network=Network(9ccfe082-59ac-4f3e-b645-e7515227e74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e35e03f-9a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG os_vif [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f4:63,bridge_name='br-int',has_traffic_filtering=True,id=0e35e03f-9a71-4d0a-afe6-ec888446e45c,network=Network(9ccfe082-59ac-4f3e-b645-e7515227e74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e35e03f-9a') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e35e03f-9a, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7094553e-6e72-456e-924b-466738a8eb46) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:50:31 user nova-compute[75813]: INFO os_vif [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f4:63,bridge_name='br-int',has_traffic_filtering=True,id=0e35e03f-9a71-4d0a-afe6-ec888446e45c,network=Network(9ccfe082-59ac-4f3e-b645-e7515227e74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e35e03f-9a')
Nov 15 12:50:31 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Deleting instance files /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01_del
Nov 15 12:50:31 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Deletion of /opt/stack/data/nova/instances/8384fa60-36fd-4ad1-b397-8bc9ab088f01_del complete
Nov 15 12:50:31 user nova-compute[75813]: INFO nova.compute.manager [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 12:50:31 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Received event network-vif-unplugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] Acquiring lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] No waiting events found dispatching network-vif-unplugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Received event network-vif-unplugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Received event network-vif-plugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] Acquiring lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] No waiting events found dispatching network-vif-plugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:50:31 user nova-compute[75813]: WARNING nova.compute.manager [req-33b50db5-21c5-4aab-9df9-5f6125e77a4d req-c7950669-818f-4d86-ad51-3306c3f490a5 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Received unexpected event network-vif-plugged-0e35e03f-9a71-4d0a-afe6-ec888446e45c for instance with vm_state active and task_state deleting.
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:50:31 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Took 0.47 seconds to deallocate network for instance.
Nov 15 12:50:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:31 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:50:32 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:50:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:32 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Deleted allocations for instance 8384fa60-36fd-4ad1-b397-8bc9ab088f01
Nov 15 12:50:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5a419f4-2e30-4167-a201-36b9874dc06e tempest-VolumesNegativeTest-1365718575 tempest-VolumesNegativeTest-1365718575-project-member] Lock "8384fa60-36fd-4ad1-b397-8bc9ab088f01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.792s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-d8527805-21db-474f-9abb-cb81a1e2486f req-2effadbf-4632-46d3-9927-953b681305e1 service nova] [instance: 8384fa60-36fd-4ad1-b397-8bc9ab088f01] Received event network-vif-deleted-0e35e03f-9a71-4d0a-afe6-ec888446e45c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:50:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:36 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:50:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:37 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:50:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:50:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:50:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:50:37 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:50:38 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Updating instance_info_cache with network_info: [{"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:50:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-48d7cb39-a436-4b01-87cc-77e917ac5c0e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:50:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:50:38 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:50:38 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:50:38 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:50:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.363s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:42 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:50:42 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8023MB free_disk=25.400440216064453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 870cf760-ae0c-4df1-99cf-6403d8e642ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 36b32262-4ea0-4a33-9672-82c7b8061bb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ec571e3e-90e0-47d4-b1ae-98a356dc43f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 0e47f02a-040d-422f-8847-40eb19df4073 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 83094942-e15d-48c6-bc0d-7c98505eb535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance d5a3f7e0-b467-4653-894e-7a5f11c9b971 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:50:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:43 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:50:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:47 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ec571e3e-90e0-47d4-b1ae-98a356dc43f6 is timed out.
Nov 15 12:50:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Successfully detached device vdb from instance ec571e3e-90e0-47d4-b1ae-98a356dc43f6 from the live domain config.
Nov 15 12:50:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUyPjpSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '9192dfbe-5fc2-495f-947e-e7d284d4e769'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:50:47 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fb7e69-f69b-4ecc-a6fc-48cc624b35b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:50:47 user nova-compute[75813]: No targets found.
Nov 15 12:50:47 user nova-compute[75813]: iSNS:
Nov 15 12:50:47 user nova-compute[75813]: No targets found.
Nov 15 12:50:47 user nova-compute[75813]: STATIC:
Nov 15 12:50:47 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769
Nov 15 12:50:47 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:47 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:47 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357
Nov 15 12:50:47 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:50:47 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:50:47 user nova-compute[75813]: FIRMWARE:
Nov 15 12:50:47 user nova-compute[75813]: No targets found.
Nov 15 12:50:47 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:50:47 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:50:47 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f52b23-d97c-451f-aaa5-b45dfba81238]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a3d309-cddd-4e49-be4e-b12c0f795410]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:47 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:47 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 (non-flash)
Nov 15 12:50:47 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:50:47 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5530788280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769'): ({'sde'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Removing single pathed devices sde {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6883bcd4-a2dd-47d7-86f6-32b041b7a832]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba069bb-67ca-44da-8fca-1bb88d9d96f7]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Flushing IO for device /dev/sde {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5588fcca-ae08-4028-894d-3f867696785f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[625c4d89-8001-49f6-a0b1-ada239a3b39b]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6c0611-4fa5-4668-9839-94a5eed823f4]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fe4ac1-41f1-40b9-8c60-5e3aa2212e3f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260]
Nov 15 12:50:47 user nova-compute[75813]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769, portal: 172.16.0.220,3260] successful.
Nov 15 12:50:47 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9192dfbe-5fc2-495f-947e-e7d284d4e769 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d81c68b-98f7-46dc-a4e6-339d45bfe1bc]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] <== disconnect_volume: return (255ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:50:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:48 user nova-compute[75813]: DEBUG nova.objects.instance [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lazy-loading 'flavor' on Instance uuid ec571e3e-90e0-47d4-b1ae-98a356dc43f6 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:50:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a5b9f13-9837-412d-b34e-27a33eadfebb tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:50:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Acquiring lock "0e47f02a-040d-422f-8847-40eb19df4073" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "0e47f02a-040d-422f-8847-40eb19df4073" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Acquiring lock "0e47f02a-040d-422f-8847-40eb19df4073-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:50:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "0e47f02a-040d-422f-8847-40eb19df4073-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:50:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "0e47f02a-040d-422f-8847-40eb19df4073-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:50:59 user nova-compute[75813]: INFO nova.compute.manager [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Terminating instance
Nov 15 12:50:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG nova.compute.manager [req-76928493-fc53-4f79-bdf1-2f0f9e74b0c8 req-1a300e78-4c21-482c-821a-a2f4c54ab14c service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Received event network-vif-unplugged-2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-76928493-fc53-4f79-bdf1-2f0f9e74b0c8 req-1a300e78-4c21-482c-821a-a2f4c54ab14c service nova] Acquiring lock "0e47f02a-040d-422f-8847-40eb19df4073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-76928493-fc53-4f79-bdf1-2f0f9e74b0c8 req-1a300e78-4c21-482c-821a-a2f4c54ab14c service nova] Lock "0e47f02a-040d-422f-8847-40eb19df4073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-76928493-fc53-4f79-bdf1-2f0f9e74b0c8 req-1a300e78-4c21-482c-821a-a2f4c54ab14c service nova] Lock "0e47f02a-040d-422f-8847-40eb19df4073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG nova.compute.manager [req-76928493-fc53-4f79-bdf1-2f0f9e74b0c8 req-1a300e78-4c21-482c-821a-a2f4c54ab14c service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] No waiting events found dispatching network-vif-unplugged-2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG nova.compute.manager [req-76928493-fc53-4f79-bdf1-2f0f9e74b0c8 req-1a300e78-4c21-482c-821a-a2f4c54ab14c service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Received event network-vif-unplugged-2b17c39b-e529-4861-862a-a18d792319eb for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:00 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Instance destroyed successfully.
Nov 15 12:51:00 user nova-compute[75813]: DEBUG nova.objects.instance [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lazy-loading 'resources' on Instance uuid 0e47f02a-040d-422f-8847-40eb19df4073 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1445511914',display_name='tempest-VolumesAssistedSnapshotsTest-server-1445511914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1445511914',id=7,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKVAJYEacrba1qyFzavdO/BUgbJuniKpQN3LPL4/NITuDxiTXvPajUlptDMQylVq/8mPkCFAt6mCPRWRLxgGbih18T062TBSOlGJXkc9jgSGsV8bdjCBlyI8NLriocKUA==',key_name='tempest-keypair-1040105164',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:48:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87366b2817cb490484846f30d737bcba',ramdisk_id='',reservation_id='r-7gi9b9z5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1432371107',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1432371107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6f1bfd1c5004266b76332081d0a5a05',uuid=0e47f02a-040d-422f-8847-40eb19df4073,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b17c39b-e529-4861-862a-a18d792319eb", "address": "fa:16:3e:47:ff:47", "network": {"id": "21c21876-9fad-43b9-aabf-195b5bcb7a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-507934887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87366b2817cb490484846f30d737bcba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b17c39b-e5", "ovs_interfaceid": "2b17c39b-e529-4861-862a-a18d792319eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Converting VIF {"id": "2b17c39b-e529-4861-862a-a18d792319eb", "address": "fa:16:3e:47:ff:47", "network": {"id": "21c21876-9fad-43b9-aabf-195b5bcb7a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-507934887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87366b2817cb490484846f30d737bcba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b17c39b-e5", "ovs_interfaceid": "2b17c39b-e529-4861-862a-a18d792319eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:ff:47,bridge_name='br-int',has_traffic_filtering=True,id=2b17c39b-e529-4861-862a-a18d792319eb,network=Network(21c21876-9fad-43b9-aabf-195b5bcb7a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b17c39b-e5') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG os_vif [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:ff:47,bridge_name='br-int',has_traffic_filtering=True,id=2b17c39b-e529-4861-862a-a18d792319eb,network=Network(21c21876-9fad-43b9-aabf-195b5bcb7a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b17c39b-e5') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b17c39b-e5, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d851464a-6306-4ae3-8da5-c3b2bed3c21f) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:00 user nova-compute[75813]: INFO os_vif [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:ff:47,bridge_name='br-int',has_traffic_filtering=True,id=2b17c39b-e529-4861-862a-a18d792319eb,network=Network(21c21876-9fad-43b9-aabf-195b5bcb7a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b17c39b-e5')
Nov 15 12:51:00 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Deleting instance files /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073_del
Nov 15 12:51:00 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Deletion of /opt/stack/data/nova/instances/0e47f02a-040d-422f-8847-40eb19df4073_del complete
Nov 15 12:51:00 user nova-compute[75813]: INFO nova.compute.manager [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 12:51:00 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:51:00 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:51:01 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:01 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Took 0.82 seconds to deallocate network for instance.
Nov 15 12:51:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-1c173aef-ccab-4833-9d2b-152858cc3749 req-0383ae54-e1c7-4cd5-9412-e17607634d6a service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Received event network-vif-deleted-2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:01 user nova-compute[75813]: INFO nova.compute.manager [req-1c173aef-ccab-4833-9d2b-152858cc3749 req-0383ae54-e1c7-4cd5-9412-e17607634d6a service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Neutron deleted interface 2b17c39b-e529-4861-862a-a18d792319eb; detaching it from the instance and deleting it from the info cache
Nov 15 12:51:01 user nova-compute[75813]: DEBUG nova.network.neutron [req-1c173aef-ccab-4833-9d2b-152858cc3749 req-0383ae54-e1c7-4cd5-9412-e17607634d6a service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-1c173aef-ccab-4833-9d2b-152858cc3749 req-0383ae54-e1c7-4cd5-9412-e17607634d6a service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Detach interface failed, port_id=2b17c39b-e529-4861-862a-a18d792319eb, reason: Instance 0e47f02a-040d-422f-8847-40eb19df4073 could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 12:51:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:01 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:51:01 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:02 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Deleted allocations for instance 0e47f02a-040d-422f-8847-40eb19df4073
Nov 15 12:51:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9ccf0f1b-830e-40fb-a554-1d9966e9a585 tempest-VolumesAssistedSnapshotsTest-1432371107 tempest-VolumesAssistedSnapshotsTest-1432371107-project-member] Lock "0e47f02a-040d-422f-8847-40eb19df4073" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-0159f655-809b-4c9e-bde7-5792aaa2817b req-22bfee7a-4e24-4d40-a6e5-42dcc66d375d service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Received event network-vif-plugged-2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0159f655-809b-4c9e-bde7-5792aaa2817b req-22bfee7a-4e24-4d40-a6e5-42dcc66d375d service nova] Acquiring lock "0e47f02a-040d-422f-8847-40eb19df4073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0159f655-809b-4c9e-bde7-5792aaa2817b req-22bfee7a-4e24-4d40-a6e5-42dcc66d375d service nova] Lock "0e47f02a-040d-422f-8847-40eb19df4073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0159f655-809b-4c9e-bde7-5792aaa2817b req-22bfee7a-4e24-4d40-a6e5-42dcc66d375d service nova] Lock "0e47f02a-040d-422f-8847-40eb19df4073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-0159f655-809b-4c9e-bde7-5792aaa2817b req-22bfee7a-4e24-4d40-a6e5-42dcc66d375d service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] No waiting events found dispatching network-vif-plugged-2b17c39b-e529-4861-862a-a18d792319eb {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:02 user nova-compute[75813]: WARNING nova.compute.manager [req-0159f655-809b-4c9e-bde7-5792aaa2817b req-22bfee7a-4e24-4d40-a6e5-42dcc66d375d service nova] [instance: 0e47f02a-040d-422f-8847-40eb19df4073] Received unexpected event network-vif-plugged-2b17c39b-e529-4861-862a-a18d792319eb for instance with vm_state deleted and task_state None.
Nov 15 12:51:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:51:02 user nova-compute[75813]: INFO nova.compute.claims [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Claim successful on node user
Nov 15 12:51:02 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:51:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:51:02 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:51:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:51:02 user nova-compute[75813]: INFO nova.virt.block_device [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Booting with volume 92952268-506b-43e2-866e-a1fff3002f69 at /dev/vda
Nov 15 12:51:03 user nova-compute[75813]: DEBUG os_brick.utils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9925318-f3d0-4473-bc99-4858094865d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b58e18-2e4c-4183-90ad-39815e1e9f45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7b8e17-b260-4afe-8c29-39df2d5774bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6756fe-0b83-40e1-b6ca-602a1b302c05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:03 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:51:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1f48f5-9404-45f1-a55f-06c762ac49ed]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG os_brick.utils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating existing volume attachment record: 55fe9a25-024d-439d-92c8-7f16ec625960 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:51:03 user nova-compute[75813]: DEBUG nova.policy [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb44a530af7148bf870621622b5eec54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d040d5bf67413aaa7185550a136c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:51:04 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully created port: 0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:51:04 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully created port: 540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:51:04 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully created port: 89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:51:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:05 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully created port: 1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:51:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:05 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully created port: c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:51:06 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully updated port: 0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:51:06 user nova-compute[75813]: DEBUG nova.compute.manager [req-11a610f9-e4cc-4c2c-9ded-0d6509bb39f9 req-cd7a66f7-a6fa-423d-84e6-b0f434df9bbb service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-changed-0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:06 user nova-compute[75813]: DEBUG nova.compute.manager [req-11a610f9-e4cc-4c2c-9ded-0d6509bb39f9 req-cd7a66f7-a6fa-423d-84e6-b0f434df9bbb service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing instance network info cache due to event network-changed-0635a5ae-c421-491c-9fce-56ac8b2ecec6. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:51:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-11a610f9-e4cc-4c2c-9ded-0d6509bb39f9 req-cd7a66f7-a6fa-423d-84e6-b0f434df9bbb service nova] Acquiring lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-11a610f9-e4cc-4c2c-9ded-0d6509bb39f9 req-cd7a66f7-a6fa-423d-84e6-b0f434df9bbb service nova] Acquired lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:06 user nova-compute[75813]: DEBUG nova.network.neutron [req-11a610f9-e4cc-4c2c-9ded-0d6509bb39f9 req-cd7a66f7-a6fa-423d-84e6-b0f434df9bbb service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing network info cache for port 0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:51:06 user nova-compute[75813]: DEBUG nova.network.neutron [req-11a610f9-e4cc-4c2c-9ded-0d6509bb39f9 req-cd7a66f7-a6fa-423d-84e6-b0f434df9bbb service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:51:06 user nova-compute[75813]: DEBUG nova.network.neutron [req-11a610f9-e4cc-4c2c-9ded-0d6509bb39f9 req-cd7a66f7-a6fa-423d-84e6-b0f434df9bbb service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-11a610f9-e4cc-4c2c-9ded-0d6509bb39f9 req-cd7a66f7-a6fa-423d-84e6-b0f434df9bbb service nova] Releasing lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully updated port: 1933fd46-434b-469e-8fb0-3b18e23266e9 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully updated port: d1a3f3dd-6674-41ba-bd0d-113faff3dc27 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:51:07 user nova-compute[75813]: INFO nova.virt.block_device [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Booting with volume 5f2168e2-b8ef-47b9-9be2-ab6277c92483 at /dev/vdb
Nov 15 12:51:07 user nova-compute[75813]: DEBUG os_brick.utils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca407a52-9683-4d5c-8596-75b424d99e89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c38aed7-7172-423c-9c7a-6fdeeaa8afbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9e1318-850f-413b-8064-b0ec1a00c99b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee92734-e72e-4f24-a10c-ea0ce3d78630]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:08 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:51:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7312c25d-1b5d-45d7-874b-e6b3b922cdd7]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG os_brick.utils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating existing volume attachment record: 70828825-3259-4c2f-b89a-47206717e737 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully updated port: 540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-changed-1933fd46-434b-469e-8fb0-3b18e23266e9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing instance network info cache due to event network-changed-1933fd46-434b-469e-8fb0-3b18e23266e9. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] Acquiring lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] Acquired lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG nova.network.neutron [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing network info cache for port 1933fd46-434b-469e-8fb0-3b18e23266e9 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG nova.network.neutron [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully updated port: 89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG nova.network.neutron [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] Releasing lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-changed-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing instance network info cache due to event network-changed-d1a3f3dd-6674-41ba-bd0d-113faff3dc27. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] Acquiring lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] Acquired lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:08 user nova-compute[75813]: DEBUG nova.network.neutron [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing network info cache for port d1a3f3dd-6674-41ba-bd0d-113faff3dc27 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG nova.network.neutron [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG nova.network.neutron [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] Releasing lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-changed-540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing instance network info cache due to event network-changed-540e4d59-b5b8-4fda-b957-00b5df385b15. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] Acquiring lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] Acquired lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG nova.network.neutron [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing network info cache for port 540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG nova.network.neutron [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully updated port: 1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG nova.network.neutron [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-130a58af-4c03-4bf9-a332-a35a1910fc30 req-4558acff-515b-49b5-b6c6-805eb3116f1a service nova] Releasing lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Successfully updated port: c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquired lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-8e83bd47-3e5e-4679-b2e1-99c9fc88f14f req-7998500d-047b-4f86-8a3a-06a2fa6b1191 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-changed-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-8e83bd47-3e5e-4679-b2e1-99c9fc88f14f req-7998500d-047b-4f86-8a3a-06a2fa6b1191 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing instance network info cache due to event network-changed-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8e83bd47-3e5e-4679-b2e1-99c9fc88f14f req-7998500d-047b-4f86-8a3a-06a2fa6b1191 service nova] Acquiring lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-changed-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing instance network info cache due to event network-changed-89d2843f-9a4c-474f-8fd2-cb4d9d48f243. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] Acquiring lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:11 user nova-compute[75813]: DEBUG nova.network.neutron [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating instance_info_cache with network_info: [{"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Releasing lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:11 user nova-compute[75813]: DEBUG nova.compute.manager [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Instance network_info: |[{"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:51:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8e83bd47-3e5e-4679-b2e1-99c9fc88f14f req-7998500d-047b-4f86-8a3a-06a2fa6b1191 service nova] Acquired lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:11 user nova-compute[75813]: DEBUG nova.network.neutron [req-8e83bd47-3e5e-4679-b2e1-99c9fc88f14f req-7998500d-047b-4f86-8a3a-06a2fa6b1191 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing network info cache for port c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG nova.network.neutron [req-8e83bd47-3e5e-4679-b2e1-99c9fc88f14f req-7998500d-047b-4f86-8a3a-06a2fa6b1191 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updated VIF entry in instance network info cache for port c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG nova.network.neutron [req-8e83bd47-3e5e-4679-b2e1-99c9fc88f14f req-7998500d-047b-4f86-8a3a-06a2fa6b1191 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating instance_info_cache with network_info: [{"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8e83bd47-3e5e-4679-b2e1-99c9fc88f14f req-7998500d-047b-4f86-8a3a-06a2fa6b1191 service nova] Releasing lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] Acquired lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG nova.network.neutron [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing network info cache for port 89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG nova.network.neutron [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updated VIF entry in instance network info cache for port 89d2843f-9a4c-474f-8fd2-cb4d9d48f243. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG nova.network.neutron [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating instance_info_cache with network_info: [{"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] Releasing lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-changed-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing instance network info cache due to event network-changed-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] Acquiring lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] Acquired lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:12 user nova-compute[75813]: DEBUG nova.network.neutron [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing network info cache for port 1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:51:12 user nova-compute[75813]: INFO nova.virt.block_device [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Booting with volume bed0f4c0-42fa-414a-99ad-9a408af0acb6 at /dev/vdc
Nov 15 12:51:13 user nova-compute[75813]: DEBUG os_brick.utils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[90628268-c2ad-47e9-bd82-ee83a2d82555]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e8cf17-481b-45f1-b6f1-8bb57788d8df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc23c0ae-e594-4c07-a211-46d199ecd1fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc209c0-59d7-47cd-94e2-3c5d8e2ed1e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:13 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa2ecaf-7a8f-4859-9ea0-56b58b974391]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG os_brick.utils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating existing volume attachment record: d26a6cf3-2aa4-4548-9122-742d238ff7e6 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG nova.network.neutron [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updated VIF entry in instance network info cache for port 1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG nova.network.neutron [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating instance_info_cache with network_info: [{"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-edb5f252-1d17-423c-b170-dbe0eba460b2 req-9288665d-d33c-41f1-ab3b-2b94f2586fe0 service nova] Releasing lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "83094942-e15d-48c6-bc0d-7c98505eb535" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "83094942-e15d-48c6-bc0d-7c98505eb535" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:14 user nova-compute[75813]: INFO nova.compute.manager [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Terminating instance
Nov 15 12:51:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-c375143b-be25-4c4f-9efe-79b081d3ae3f req-fda068bf-0af9-4870-833a-47e3eee84cad service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Received event network-vif-unplugged-956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c375143b-be25-4c4f-9efe-79b081d3ae3f req-fda068bf-0af9-4870-833a-47e3eee84cad service nova] Acquiring lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c375143b-be25-4c4f-9efe-79b081d3ae3f req-fda068bf-0af9-4870-833a-47e3eee84cad service nova] Lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c375143b-be25-4c4f-9efe-79b081d3ae3f req-fda068bf-0af9-4870-833a-47e3eee84cad service nova] Lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-c375143b-be25-4c4f-9efe-79b081d3ae3f req-fda068bf-0af9-4870-833a-47e3eee84cad service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] No waiting events found dispatching network-vif-unplugged-956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-c375143b-be25-4c4f-9efe-79b081d3ae3f req-fda068bf-0af9-4870-833a-47e3eee84cad service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Received event network-vif-unplugged-956d00c4-90f7-4885-acc3-b17afda2a416 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Instance destroyed successfully.
Nov 15 12:51:15 user nova-compute[75813]: DEBUG nova.objects.instance [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lazy-loading 'resources' on Instance uuid 83094942-e15d-48c6-bc0d-7c98505eb535 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1480907982',display_name='tempest-ServersNegativeTestJSON-server-1480907982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1480907982',id=10,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:49:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abb93fcbc60e4efbb8d3bb0c657f1b64',ramdisk_id='',reservation_id='r-lrwivclt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-880603076',owner_user_name='tempest-ServersNegativeTestJSON-880603076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:49:31Z,user_data=None,user_id='46c14d0607324e6ba1e447b5f5945a99',uuid=83094942-e15d-48c6-bc0d-7c98505eb535,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "956d00c4-90f7-4885-acc3-b17afda2a416", "address": "fa:16:3e:43:b0:5c", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956d00c4-90", "ovs_interfaceid": "956d00c4-90f7-4885-acc3-b17afda2a416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converting VIF {"id": "956d00c4-90f7-4885-acc3-b17afda2a416", "address": "fa:16:3e:43:b0:5c", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956d00c4-90", "ovs_interfaceid": "956d00c4-90f7-4885-acc3-b17afda2a416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=956d00c4-90f7-4885-acc3-b17afda2a416,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956d00c4-90') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG os_vif [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=956d00c4-90f7-4885-acc3-b17afda2a416,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956d00c4-90') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap956d00c4-90, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce0f8ffb-554b-4e88-88bd-789e60c8bb86) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:15 user nova-compute[75813]: INFO os_vif [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=956d00c4-90f7-4885-acc3-b17afda2a416,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956d00c4-90')
Nov 15 12:51:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Deleting instance files /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535_del
Nov 15 12:51:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Deletion of /opt/stack/data/nova/instances/83094942-e15d-48c6-bc0d-7c98505eb535_del complete
Nov 15 12:51:15 user nova-compute[75813]: INFO nova.compute.manager [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 12:51:15 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:15 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Took 0.42 seconds to deallocate network for instance.
Nov 15 12:51:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:51:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:15 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Deleted allocations for instance 83094942-e15d-48c6-bc0d-7c98505eb535
Nov 15 12:51:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cdb9c2e5-01bd-4e64-8ac1-452dbe1d1c42 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "83094942-e15d-48c6-bc0d-7c98505eb535" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.503s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-3cf5084b-f499-40dc-9e8f-fe743e86ffdb req-17ade608-f616-4863-a550-3f3c8940e6d5 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Received event network-vif-plugged-956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3cf5084b-f499-40dc-9e8f-fe743e86ffdb req-17ade608-f616-4863-a550-3f3c8940e6d5 service nova] Acquiring lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3cf5084b-f499-40dc-9e8f-fe743e86ffdb req-17ade608-f616-4863-a550-3f3c8940e6d5 service nova] Lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3cf5084b-f499-40dc-9e8f-fe743e86ffdb req-17ade608-f616-4863-a550-3f3c8940e6d5 service nova] Lock "83094942-e15d-48c6-bc0d-7c98505eb535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-3cf5084b-f499-40dc-9e8f-fe743e86ffdb req-17ade608-f616-4863-a550-3f3c8940e6d5 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] No waiting events found dispatching network-vif-plugged-956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:16 user nova-compute[75813]: WARNING nova.compute.manager [req-3cf5084b-f499-40dc-9e8f-fe743e86ffdb req-17ade608-f616-4863-a550-3f3c8940e6d5 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Received unexpected event network-vif-plugged-956d00c4-90f7-4885-acc3-b17afda2a416 for instance with vm_state deleted and task_state None.
Nov 15 12:51:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-3cf5084b-f499-40dc-9e8f-fe743e86ffdb req-17ade608-f616-4863-a550-3f3c8940e6d5 service nova] [instance: 83094942-e15d-48c6-bc0d-7c98505eb535] Received event network-vif-deleted-956d00c4-90f7-4885-acc3-b17afda2a416 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:17 user nova-compute[75813]: INFO nova.compute.manager [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Terminating instance
Nov 15 12:51:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:51:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:51:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Creating image(s)
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Ensure instance console log exists: /opt/stack/data/nova/instances/fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Start _get_guest_xml network_info=[{"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '55fe9a25-024d-439d-92c8-7f16ec625960', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPvNJrzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02', 'attached_at': '', 'detached_at': '', 'volume_id': '92952268-506b-43e2-866e-a1fff3002f69', 'serial': '92952268-506b-43e2-866e-a1fff3002f69'}, 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '70828825-3259-4c2f-b89a-47206717e737', 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVZLTOqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02', 'attached_at': '', 'detached_at': '', 'volume_id': '5f2168e2-b8ef-47b9-9be2-ab6277c92483', 'serial': '5f2168e2-b8ef-47b9-9be2-ab6277c92483'}, 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'attachment_id': 'd26a6cf3-2aa4-4548-9122-742d238ff7e6', 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyKtJYdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02', 'attached_at': '', 'detached_at': '', 'volume_id': 'bed0f4c0-42fa-414a-99ad-9a408af0acb6', 'serial': 'bed0f4c0-42fa-414a-99ad-9a408af0acb6'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:51:18 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:51:18 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPvNJrzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:18 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:18 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:18 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd6fb4e-c510-49b1-a8cf-0b27f566ce09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:51:18 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[193fd063-aba2-40a5-a1f8-e598dcf43d05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69] added
Nov 15 12:51:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a0601a-7216-458b-94d3-4481e26de15b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30bdc52-5384-4ad9-bc9a-4b2c642b5d75]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPvNJrzI {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPvNJrzI" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a95db90-3aea-4fbf-8a74-c96956d421e3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nPvNJrzI'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d007cc7-3f91-4080-a801-7e8680ff9acf]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c63779-c111-4c3e-9eda-ed940b3d2eba]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d68f25-12a5-4605-bdd9-ea386dc18811]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69, portal: 172.16.0.220,3260]
Nov 15 12:51:18 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69, portal: 172.16.0.220,3260] successful.
Nov 15 12:51:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Instance destroyed successfully.
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lazy-loading 'resources' on Instance uuid ec571e3e-90e0-47d4-b1ae-98a356dc43f6 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1624136279',display_name='tempest-TestVolumeSwap-server-1624136279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1624136279',id=5,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbLoQ1y8xYEofh6p1JVunwap9/uY/rmeKT758ldhZK5dT0enA4RhmL7unHJcHlvVKON3Pyf9gA1nxrRoHuzRsNp00OsYIafvfQq/D1aFac+8SapUThWLfpEgcB+Us3TTw==',key_name='tempest-keypair-971338812',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec31cbd1cad4e7cb23e1fb4616b00c4',ramdisk_id='',reservation_id='r-6hkka86w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1733659781',owner_user_name='tempest-TestVolumeSwap-1733659781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e917cad7442343d9927b1cee60d221c7',uuid=ec571e3e-90e0-47d4-b1ae-98a356dc43f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "address": "fa:16:3e:b3:d6:37", "network": {"id": "ad54a03a-4017-4bdf-8b27-2fee2d038d2d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1945739865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec31cbd1cad4e7cb23e1fb4616b00c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d6bc55-a4", "ovs_interfaceid": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Converting VIF {"id": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "address": "fa:16:3e:b3:d6:37", "network": {"id": "ad54a03a-4017-4bdf-8b27-2fee2d038d2d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1945739865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec31cbd1cad4e7cb23e1fb4616b00c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d6bc55-a4", "ovs_interfaceid": "96d6bc55-a485-4bfe-8bc5-b6978bababb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=96d6bc55-a485-4bfe-8bc5-b6978bababb3,network=Network(ad54a03a-4017-4bdf-8b27-2fee2d038d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d6bc55-a4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_vif [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=96d6bc55-a485-4bfe-8bc5-b6978bababb3,network=Network(ad54a03a-4017-4bdf-8b27-2fee2d038d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d6bc55-a4') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[354a337a-01ba-4903-b07f-d1c25889a9d3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96d6bc55-a4, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d5c3c95-04d5-4297-8e71-af5f2b72dff8) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:18 user nova-compute[75813]: INFO os_vif [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=96d6bc55-a485-4bfe-8bc5-b6978bababb3,network=Network(ad54a03a-4017-4bdf-8b27-2fee2d038d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d6bc55-a4')
Nov 15 12:51:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Deleting instance files /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6_del
Nov 15 12:51:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Deletion of /opt/stack/data/nova/instances/ec571e3e-90e0-47d4-b1ae-98a356dc43f6_del complete
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a17a8f3-3110-4d42-9456-107215559e09]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:18 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:18 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0496a97c-d3e9-4df0-97d2-d913a7831065]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:51:18 user nova-compute[75813]: INFO nova.compute.manager [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 15 12:51:18 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:51:18 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Received event network-vif-unplugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] No waiting events found dispatching network-vif-unplugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Received event network-vif-unplugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Received event network-vif-plugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] Acquiring lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] No waiting events found dispatching network-vif-plugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:19 user nova-compute[75813]: WARNING nova.compute.manager [req-311e6c6f-91f8-4c3d-a581-f02b708b9045 req-5aae241c-2489-4aa8-89cf-f2b8680091cb service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Received unexpected event network-vif-plugged-96d6bc55-a485-4bfe-8bc5-b6978bababb3 for instance with vm_state active and task_state deleting.
Nov 15 12:51:19 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:19 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Took 0.93 seconds to deallocate network for instance.
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPvNJrzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26661646365613365', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661646365613365', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVZLTOqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:19 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:19 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:19 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[13721cc4-e28d-4df1-a493-a739a1957561]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:51:19 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[32168824-e8e0-4927-94f2-0c1c6773e31d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483] added
Nov 15 12:51:19 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe06bce-49be-4ad6-bb54-d9d23a667929]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed184bd-2def-42c2-9fe6-5fa512bcb9d5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVZLTOqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVZLTOqn" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[80899e12-1af3-4467-a587-a9cc0aa0845e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cVZLTOqn'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b05651-a815-4efe-8504-6f8ffdc24959]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[198e9eba-1884-49ef-acb0-30e96a8a8776]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:19 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:19 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:19 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:19 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fa5775-cf83-4271-a92c-c599f7e9ef6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483, portal: 172.16.0.220,3260]
Nov 15 12:51:19 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483, portal: 172.16.0.220,3260] successful.
Nov 15 12:51:19 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0477600-2f1f-4346-9066-8fb23fdc782f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec3d065-9b16-44d7-a831-75bb9f7e8d4c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:19 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:19 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:19 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:19 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:19 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:19 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:51:19 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Deleted allocations for instance ec571e3e-90e0-47d4-b1ae-98a356dc43f6
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc782371-749d-49da-a48d-c38ca2af6106]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVZLTOqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:51:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1a933881-a92e-4d54-8b66-fae3bfb96779 tempest-TestVolumeSwap-1733659781 tempest-TestVolumeSwap-1733659781-project-member] Lock "ec571e3e-90e0-47d4-b1ae-98a356dc43f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.515s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23033303834363263', 'path': '/dev/sdd'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033303834363263', 'path': '/dev/sdd'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyKtJYdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:20 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:20 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:20 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92451d6-b5a5-4a33-9a8f-2c6750ae46f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:51:20 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc89197f-7621-4dad-87cb-0f9281160d47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6] added
Nov 15 12:51:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[50681054-702e-456b-9cf0-e51e99ddb55d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9826a9e4-3cba-401e-a0c9-4642e5b7ab13]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyKtJYdH {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyKtJYdH" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1f4563-389f-46b6-8571-00001e9dd14a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QyKtJYdH'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[71579e0f-cdf8-4b36-9f27-bf9578292f99]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8520cd0-7ef5-40ac-9ba8-d8927bf3b467]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9c37e6-d27d-4039-9ae9-655088e3c530]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6, portal: 172.16.0.220,3260]
Nov 15 12:51:21 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6, portal: 172.16.0.220,3260] successful.
Nov 15 12:51:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b382e7-ffd7-48b2-938f-32b1091f4ac1]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-6226588b-07bd-4955-a468-7ee747e3cda9 req-c5697c4c-0319-47b8-bd10-c48e1ba77970 service nova] [instance: ec571e3e-90e0-47d4-b1ae-98a356dc43f6] Received event network-vif-deleted-96d6bc55-a485-4bfe-8bc5-b6978bababb3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ae4420-5f58-4f19-959d-fef1cab6509e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b01933-7727-4768-8910-febf0d72505b]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:51:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyKtJYdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23838646232393235', 'path': '/dev/sde'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838646232393235', 'path': '/dev/sde'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:62:46,bridge_name='br-int',has_traffic_filtering=True,id=0635a5ae-c421-491c-9fce-56ac8b2ecec6,network=Network(bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0635a5ae-c4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bd:4f,bridge_name='br-int',has_traffic_filtering=True,id=1933fd46-434b-469e-8fb0-3b18e23266e9,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1933fd46-43') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:83:d9,bridge_name='br-int',has_traffic_filtering=True,id=d1a3f3dd-6674-41ba-bd0d-113faff3dc27,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1a3f3dd-66') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:5f:0f,bridge_name='br-int',has_traffic_filtering=True,id=540e4d59-b5b8-4fda-b957-00b5df385b15,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e4d59-b5') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b7:e0,bridge_name='br-int',has_traffic_filtering=True,id=89d2843f-9a4c-474f-8fd2-cb4d9d48f243,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d2843f-9a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ccbc89d-26') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:59:59,bridge_name='br-int',has_traffic_filtering=True,id=c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5af2fa9-ac') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.objects.instance [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lazy-loading 'pci_devices' on Instance uuid fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:51:22 user nova-compute[75813]:   <uuid>fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02</uuid>
Nov 15 12:51:22 user nova-compute[75813]:   <name>instance-0000000c</name>
Nov 15 12:51:22 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:51:22 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:51:22 user nova-compute[75813]:   <metadata>
Nov 15 12:51:22 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:51:22 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:51:22 user nova-compute[75813]:       <nova:name>tempest-device-tagging-server-1328978709</nova:name>
Nov 15 12:51:22 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:51:18</nova:creationTime>
Nov 15 12:51:22 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:51:22 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:51:22 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:51:22 user nova-compute[75813]:       <nova:owner>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:user uuid="eb44a530af7148bf870621622b5eec54">tempest-TaggedBootDevicesTest-697679330-project-member</nova:user>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:project uuid="75d040d5bf67413aaa7185550a136c5d">tempest-TaggedBootDevicesTest-697679330</nova:project>
Nov 15 12:51:22 user nova-compute[75813]:       </nova:owner>
Nov 15 12:51:22 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:51:22 user nova-compute[75813]:       <nova:ports>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:port uuid="0635a5ae-c421-491c-9fce-56ac8b2ecec6">
Nov 15 12:51:22 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 12:51:22 user nova-compute[75813]:         </nova:port>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:port uuid="1933fd46-434b-469e-8fb0-3b18e23266e9">
Nov 15 12:51:22 user nova-compute[75813]:           <nova:ip type="fixed" address="10.1.1.109" ipVersion="4"/>
Nov 15 12:51:22 user nova-compute[75813]:         </nova:port>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:port uuid="d1a3f3dd-6674-41ba-bd0d-113faff3dc27">
Nov 15 12:51:22 user nova-compute[75813]:           <nova:ip type="fixed" address="10.1.1.70" ipVersion="4"/>
Nov 15 12:51:22 user nova-compute[75813]:         </nova:port>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:port uuid="540e4d59-b5b8-4fda-b957-00b5df385b15">
Nov 15 12:51:22 user nova-compute[75813]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Nov 15 12:51:22 user nova-compute[75813]:         </nova:port>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:port uuid="89d2843f-9a4c-474f-8fd2-cb4d9d48f243">
Nov 15 12:51:22 user nova-compute[75813]:           <nova:ip type="fixed" address="10.1.1.92" ipVersion="4"/>
Nov 15 12:51:22 user nova-compute[75813]:         </nova:port>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:port uuid="1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c">
Nov 15 12:51:22 user nova-compute[75813]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 12:51:22 user nova-compute[75813]:         </nova:port>
Nov 15 12:51:22 user nova-compute[75813]:         <nova:port uuid="c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2">
Nov 15 12:51:22 user nova-compute[75813]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 12:51:22 user nova-compute[75813]:         </nova:port>
Nov 15 12:51:22 user nova-compute[75813]:       </nova:ports>
Nov 15 12:51:22 user nova-compute[75813]:     </nova:instance>
Nov 15 12:51:22 user nova-compute[75813]:   </metadata>
Nov 15 12:51:22 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:51:22 user nova-compute[75813]:     <system>
Nov 15 12:51:22 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:51:22 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:51:22 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:51:22 user nova-compute[75813]:       <entry name="serial">fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02</entry>
Nov 15 12:51:22 user nova-compute[75813]:       <entry name="uuid">fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02</entry>
Nov 15 12:51:22 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:51:22 user nova-compute[75813]:     </system>
Nov 15 12:51:22 user nova-compute[75813]:   </sysinfo>
Nov 15 12:51:22 user nova-compute[75813]:   <os>
Nov 15 12:51:22 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:51:22 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:51:22 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:51:22 user nova-compute[75813]:   </os>
Nov 15 12:51:22 user nova-compute[75813]:   <features>
Nov 15 12:51:22 user nova-compute[75813]:     <acpi/>
Nov 15 12:51:22 user nova-compute[75813]:     <apic/>
Nov 15 12:51:22 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:51:22 user nova-compute[75813]:   </features>
Nov 15 12:51:22 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:51:22 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:51:22 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:51:22 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:51:22 user nova-compute[75813]:   </clock>
Nov 15 12:51:22 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:51:22 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:51:22 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:51:22 user nova-compute[75813]:   </cpu>
Nov 15 12:51:22 user nova-compute[75813]:   <devices>
Nov 15 12:51:22 user nova-compute[75813]:     <disk type="file" device="cdrom">
Nov 15 12:51:22 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 12:51:22 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02/disk.config"/>
Nov 15 12:51:22 user nova-compute[75813]:       <target dev="hda" bus="ide"/>
Nov 15 12:51:22 user nova-compute[75813]:     </disk>
Nov 15 12:51:22 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 12:51:22 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:51:22 user nova-compute[75813]:       <source dev="/dev/sdc"/>
Nov 15 12:51:22 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:51:22 user nova-compute[75813]:       <serial>92952268-506b-43e2-866e-a1fff3002f69</serial>
Nov 15 12:51:22 user nova-compute[75813]:     </disk>
Nov 15 12:51:22 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 12:51:22 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:51:22 user nova-compute[75813]:       <source dev="/dev/sdd"/>
Nov 15 12:51:22 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 12:51:22 user nova-compute[75813]:       <serial>5f2168e2-b8ef-47b9-9be2-ab6277c92483</serial>
Nov 15 12:51:22 user nova-compute[75813]:     </disk>
Nov 15 12:51:22 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 12:51:22 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:51:22 user nova-compute[75813]:       <source dev="/dev/sde"/>
Nov 15 12:51:22 user nova-compute[75813]:       <target dev="vdc" bus="virtio"/>
Nov 15 12:51:22 user nova-compute[75813]:       <serial>bed0f4c0-42fa-414a-99ad-9a408af0acb6</serial>
Nov 15 12:51:22 user nova-compute[75813]:     </disk>
Nov 15 12:51:22 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:51:22 user nova-compute[75813]:       <mac address="fa:16:3e:8d:62:46"/>
Nov 15 12:51:22 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:22 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:51:22 user nova-compute[75813]:       <target dev="tap0635a5ae-c4"/>
Nov 15 12:51:22 user nova-compute[75813]:     </interface>
Nov 15 12:51:22 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:51:22 user nova-compute[75813]:       <mac address="fa:16:3e:05:bd:4f"/>
Nov 15 12:51:22 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:22 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:51:22 user nova-compute[75813]:       <target dev="tap1933fd46-43"/>
Nov 15 12:51:22 user nova-compute[75813]:     </interface>
Nov 15 12:51:22 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:51:22 user nova-compute[75813]:       <mac address="fa:16:3e:7c:83:d9"/>
Nov 15 12:51:22 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:22 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:51:22 user nova-compute[75813]:       <target dev="tapd1a3f3dd-66"/>
Nov 15 12:51:22 user nova-compute[75813]:     </interface>
Nov 15 12:51:22 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:51:22 user nova-compute[75813]:       <mac address="fa:16:3e:d2:5f:0f"/>
Nov 15 12:51:22 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:22 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:51:22 user nova-compute[75813]:       <target dev="tap540e4d59-b5"/>
Nov 15 12:51:22 user nova-compute[75813]:     </interface>
Nov 15 12:51:22 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:51:22 user nova-compute[75813]:       <mac address="fa:16:3e:dd:b7:e0"/>
Nov 15 12:51:22 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:22 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:51:22 user nova-compute[75813]:       <target dev="tap89d2843f-9a"/>
Nov 15 12:51:22 user nova-compute[75813]:     </interface>
Nov 15 12:51:22 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:51:22 user nova-compute[75813]:       <mac address="fa:16:3e:d2:fc:c7"/>
Nov 15 12:51:22 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:22 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:51:22 user nova-compute[75813]:       <target dev="tap1ccbc89d-26"/>
Nov 15 12:51:22 user nova-compute[75813]:     </interface>
Nov 15 12:51:22 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:51:22 user nova-compute[75813]:       <mac address="fa:16:3e:e1:59:59"/>
Nov 15 12:51:22 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:22 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:51:22 user nova-compute[75813]:       <target dev="tapc5af2fa9-ac"/>
Nov 15 12:51:22 user nova-compute[75813]:     </interface>
Nov 15 12:51:22 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:51:22 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02/console.log" append="off"/>
Nov 15 12:51:22 user nova-compute[75813]:     </serial>
Nov 15 12:51:22 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:51:22 user nova-compute[75813]:     <video>
Nov 15 12:51:22 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:22 user nova-compute[75813]:     </video>
Nov 15 12:51:22 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:51:22 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:51:22 user nova-compute[75813]:     </rng>
Nov 15 12:51:22 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:51:22 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:51:22 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:51:22 user nova-compute[75813]:     </memballoon>
Nov 15 12:51:22 user nova-compute[75813]:   </devices>
Nov 15 12:51:22 user nova-compute[75813]: </domain>
Nov 15 12:51:22 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:62:46,bridge_name='br-int',has_traffic_filtering=True,id=0635a5ae-c421-491c-9fce-56ac8b2ecec6,network=Network(bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0635a5ae-c4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:62:46,bridge_name='br-int',has_traffic_filtering=True,id=0635a5ae-c421-491c-9fce-56ac8b2ecec6,network=Network(bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0635a5ae-c4') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c960697-ce64-5d92-a033-43efe3eb164a', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0635a5ae-c4, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0635a5ae-c4, col_values=(('qos', UUID('c1991ec5-14ed-42b3-ae1c-86861097d9ca')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0635a5ae-c4, col_values=(('external_ids', {'iface-id': '0635a5ae-c421-491c-9fce-56ac8b2ecec6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:62:46', 'vm-uuid': 'fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: INFO os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:62:46,bridge_name='br-int',has_traffic_filtering=True,id=0635a5ae-c421-491c-9fce-56ac8b2ecec6,network=Network(bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0635a5ae-c4')
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bd:4f,bridge_name='br-int',has_traffic_filtering=True,id=1933fd46-434b-469e-8fb0-3b18e23266e9,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1933fd46-43') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bd:4f,bridge_name='br-int',has_traffic_filtering=True,id=1933fd46-434b-469e-8fb0-3b18e23266e9,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1933fd46-43') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9513f11-9fa6-5208-9805-6ac25fd15e2d', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1933fd46-43, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1933fd46-43, col_values=(('qos', UUID('3ff4695e-fde5-461f-bd56-19dda3333864')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1933fd46-43, col_values=(('external_ids', {'iface-id': '1933fd46-434b-469e-8fb0-3b18e23266e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:bd:4f', 'vm-uuid': 'fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: INFO os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bd:4f,bridge_name='br-int',has_traffic_filtering=True,id=1933fd46-434b-469e-8fb0-3b18e23266e9,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1933fd46-43')
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:83:d9,bridge_name='br-int',has_traffic_filtering=True,id=d1a3f3dd-6674-41ba-bd0d-113faff3dc27,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1a3f3dd-66') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:83:d9,bridge_name='br-int',has_traffic_filtering=True,id=d1a3f3dd-6674-41ba-bd0d-113faff3dc27,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1a3f3dd-66') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff1ab12b-cd37-523d-80e7-a34775aabfa7', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1a3f3dd-66, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1a3f3dd-66, col_values=(('qos', UUID('9553b2da-be5d-48e2-9b5a-637aaebc529b')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1a3f3dd-66, col_values=(('external_ids', {'iface-id': 'd1a3f3dd-6674-41ba-bd0d-113faff3dc27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:83:d9', 'vm-uuid': 'fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: INFO os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:83:d9,bridge_name='br-int',has_traffic_filtering=True,id=d1a3f3dd-6674-41ba-bd0d-113faff3dc27,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1a3f3dd-66')
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:5f:0f,bridge_name='br-int',has_traffic_filtering=True,id=540e4d59-b5b8-4fda-b957-00b5df385b15,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e4d59-b5') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:5f:0f,bridge_name='br-int',has_traffic_filtering=True,id=540e4d59-b5b8-4fda-b957-00b5df385b15,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e4d59-b5') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '996be06c-4ce4-507f-9172-556953ea705a', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap540e4d59-b5, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap540e4d59-b5, col_values=(('qos', UUID('d06fb3b0-a3a1-49e3-85ad-5ab1b0a86a17')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap540e4d59-b5, col_values=(('external_ids', {'iface-id': '540e4d59-b5b8-4fda-b957-00b5df385b15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:5f:0f', 'vm-uuid': 'fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: INFO os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:5f:0f,bridge_name='br-int',has_traffic_filtering=True,id=540e4d59-b5b8-4fda-b957-00b5df385b15,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e4d59-b5')
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b7:e0,bridge_name='br-int',has_traffic_filtering=True,id=89d2843f-9a4c-474f-8fd2-cb4d9d48f243,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d2843f-9a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b7:e0,bridge_name='br-int',has_traffic_filtering=True,id=89d2843f-9a4c-474f-8fd2-cb4d9d48f243,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d2843f-9a') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91bc25da-2ff7-5b2e-9972-4256d6c2d894', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89d2843f-9a, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89d2843f-9a, col_values=(('qos', UUID('53731c45-0e21-4da1-a0db-0201aac37e32')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89d2843f-9a, col_values=(('external_ids', {'iface-id': '89d2843f-9a4c-474f-8fd2-cb4d9d48f243', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:b7:e0', 'vm-uuid': 'fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: INFO os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b7:e0,bridge_name='br-int',has_traffic_filtering=True,id=89d2843f-9a4c-474f-8fd2-cb4d9d48f243,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d2843f-9a')
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ccbc89d-26') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ccbc89d-26') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2f25271-220b-5c55-bfee-7415c09ea001', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ccbc89d-26, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ccbc89d-26, col_values=(('qos', UUID('15610228-c492-4a3c-9da7-eeb38fed19ed')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ccbc89d-26, col_values=(('external_ids', {'iface-id': '1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:fc:c7', 'vm-uuid': 'fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: INFO os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ccbc89d-26')
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:59:59,bridge_name='br-int',has_traffic_filtering=True,id=c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5af2fa9-ac') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:59:59,bridge_name='br-int',has_traffic_filtering=True,id=c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5af2fa9-ac') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '170a11ed-869e-5123-97f9-960b175e27f0', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5af2fa9-ac, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5af2fa9-ac, col_values=(('qos', UUID('bd513716-a023-48e5-8374-894c3b66a9de')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5af2fa9-ac, col_values=(('external_ids', {'iface-id': 'c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:59:59', 'vm-uuid': 'fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:22 user nova-compute[75813]: INFO os_vif [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:59:59,bridge_name='br-int',has_traffic_filtering=True,id=c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5af2fa9-ac')
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] No BDM found with device name hda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] No VIF found with MAC fa:16:3e:8d:62:46, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:51:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] No VIF found with MAC fa:16:3e:dd:b7:e0, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:51:22 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Using config drive
Nov 15 12:51:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:23 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Creating config drive at /opt/stack/data/nova/instances/fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02/disk.config
Nov 15 12:51:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq8x115rq {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq8x115rq" returned: 0 in 0.051s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-8bce903e-96ce-4f02-8fbc-5a37d2c83fe9 req-ff451473-d8fc-4b00-a235-8974078310dd service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8bce903e-96ce-4f02-8fbc-5a37d2c83fe9 req-ff451473-d8fc-4b00-a235-8974078310dd service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8bce903e-96ce-4f02-8fbc-5a37d2c83fe9 req-ff451473-d8fc-4b00-a235-8974078310dd service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8bce903e-96ce-4f02-8fbc-5a37d2c83fe9 req-ff451473-d8fc-4b00-a235-8974078310dd service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-8bce903e-96ce-4f02-8fbc-5a37d2c83fe9 req-ff451473-d8fc-4b00-a235-8974078310dd service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:24 user nova-compute[75813]: WARNING nova.compute.manager [req-8bce903e-96ce-4f02-8fbc-5a37d2c83fe9 req-ff451473-d8fc-4b00-a235-8974078310dd service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 for instance with vm_state building and task_state spawning.
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-04167dc3-82fb-4771-8816-715205e8ff74 req-d2d46f9f-5388-433d-90cc-e7aba218b10d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-1933fd46-434b-469e-8fb0-3b18e23266e9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-04167dc3-82fb-4771-8816-715205e8ff74 req-d2d46f9f-5388-433d-90cc-e7aba218b10d service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-04167dc3-82fb-4771-8816-715205e8ff74 req-d2d46f9f-5388-433d-90cc-e7aba218b10d service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-04167dc3-82fb-4771-8816-715205e8ff74 req-d2d46f9f-5388-433d-90cc-e7aba218b10d service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-04167dc3-82fb-4771-8816-715205e8ff74 req-d2d46f9f-5388-433d-90cc-e7aba218b10d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-1933fd46-434b-469e-8fb0-3b18e23266e9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:25 user nova-compute[75813]: WARNING nova.compute.manager [req-04167dc3-82fb-4771-8816-715205e8ff74 req-d2d46f9f-5388-433d-90cc-e7aba218b10d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-1933fd46-434b-469e-8fb0-3b18e23266e9 for instance with vm_state building and task_state spawning.
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-09a33c53-81be-4c1c-a139-ec13716f2e2e req-5c5d85ec-ca5b-4133-85df-94e446ec878a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-09a33c53-81be-4c1c-a139-ec13716f2e2e req-5c5d85ec-ca5b-4133-85df-94e446ec878a service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-09a33c53-81be-4c1c-a139-ec13716f2e2e req-5c5d85ec-ca5b-4133-85df-94e446ec878a service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-09a33c53-81be-4c1c-a139-ec13716f2e2e req-5c5d85ec-ca5b-4133-85df-94e446ec878a service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-09a33c53-81be-4c1c-a139-ec13716f2e2e req-5c5d85ec-ca5b-4133-85df-94e446ec878a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:25 user nova-compute[75813]: WARNING nova.compute.manager [req-09a33c53-81be-4c1c-a139-ec13716f2e2e req-5c5d85ec-ca5b-4133-85df-94e446ec878a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-540e4d59-b5b8-4fda-b957-00b5df385b15 for instance with vm_state building and task_state spawning.
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:27 user nova-compute[75813]: WARNING nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 for instance with vm_state building and task_state spawning.
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:27 user nova-compute[75813]: WARNING nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 for instance with vm_state building and task_state spawning.
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:27 user nova-compute[75813]: WARNING nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 for instance with vm_state building and task_state spawning.
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:27 user nova-compute[75813]: WARNING nova.compute.manager [req-f7ade635-304d-4b09-85ac-6b3c4ca8511b req-82e69557-e0f3-4fba-a41a-9d128f5f8af1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 for instance with vm_state building and task_state spawning.
Nov 15 12:51:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-1933fd46-434b-469e-8fb0-3b18e23266e9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-1933fd46-434b-469e-8fb0-3b18e23266e9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:27 user nova-compute[75813]: WARNING nova.compute.manager [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-1933fd46-434b-469e-8fb0-3b18e23266e9 for instance with vm_state building and task_state spawning.
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:27 user nova-compute[75813]: WARNING nova.compute.manager [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c for instance with vm_state building and task_state spawning.
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:27 user nova-compute[75813]: WARNING nova.compute.manager [req-4d885dd4-7ef1-4a51-9b5b-20bf53efefbb req-a0520763-5fc1-4ac7-998d-77def5603361 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c for instance with vm_state building and task_state spawning.
Nov 15 12:51:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:27 user nova-compute[75813]: DEBUG nova.objects.instance [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lazy-loading 'flavor' on Instance uuid 36b32262-4ea0-4a33-9672-82c7b8061bb1 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG nova.compute.manager [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG nova.compute.manager [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:28 user nova-compute[75813]: WARNING nova.compute.manager [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-540e4d59-b5b8-4fda-b957-00b5df385b15 for instance with vm_state building and task_state spawning.
Nov 15 12:51:28 user nova-compute[75813]: DEBUG nova.compute.manager [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG nova.compute.manager [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:28 user nova-compute[75813]: WARNING nova.compute.manager [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 for instance with vm_state building and task_state spawning.
Nov 15 12:51:28 user nova-compute[75813]: DEBUG nova.compute.manager [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG nova.compute.manager [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:28 user nova-compute[75813]: WARNING nova.compute.manager [req-54174d65-6434-41da-8991-1b0eb2cd7510 req-50e9e1e4-6031-4f4f-b4cf-ab1e5ed2419e service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 for instance with vm_state building and task_state spawning.
Nov 15 12:51:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:28 user nova-compute[75813]: INFO nova.compute.manager [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Attaching volume 2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda to /dev/vdb
Nov 15 12:51:28 user nova-compute[75813]: DEBUG os_brick.utils [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03c5f68-5050-4829-9b16-dc8702bfdc7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31b5f17-d598-4590-9ada-8fd0db3abcc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7fa4b4-522f-4105-b1b4-1aed3d081a7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1ff978-9cfc-4cf9-bf68-2412997165e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:28 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:51:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d154344-43de-4adf-9806-c19d845d98f6]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG os_brick.utils [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating existing volume attachment record: 5acba910-8822-4a47-8593-8b91238dc22e {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:51:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-82ce0cbb-5f15-4ed5-8bd9-cb8f70439d54 req-53fe5f59-da19-4651-a671-10d0adbb0214 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-82ce0cbb-5f15-4ed5-8bd9-cb8f70439d54 req-53fe5f59-da19-4651-a671-10d0adbb0214 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-82ce0cbb-5f15-4ed5-8bd9-cb8f70439d54 req-53fe5f59-da19-4651-a671-10d0adbb0214 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-82ce0cbb-5f15-4ed5-8bd9-cb8f70439d54 req-53fe5f59-da19-4651-a671-10d0adbb0214 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-82ce0cbb-5f15-4ed5-8bd9-cb8f70439d54 req-53fe5f59-da19-4651-a671-10d0adbb0214 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:29 user nova-compute[75813]: WARNING nova.compute.manager [req-82ce0cbb-5f15-4ed5-8bd9-cb8f70439d54 req-53fe5f59-da19-4651-a671-10d0adbb0214 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 for instance with vm_state building and task_state spawning.
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:51:29 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Instance spawned successfully.
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:29 user nova-compute[75813]: INFO nova.compute.manager [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Took 11.35 seconds to spawn the instance on the hypervisor.
Nov 15 12:51:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:51:29 user nova-compute[75813]: INFO nova.compute.manager [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Took 27.09 seconds to build instance.
Nov 15 12:51:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e3776d27-ccc2-4c99-bcba-44fe0b1921b5 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.186s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaXgiKyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:33 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:33 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:33 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9845a4c-64e0-4548-b69d-89011c8ead80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:51:33 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c818f47-a375-423e-863f-e7d433abdc84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda] added
Nov 15 12:51:33 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4f2e5c-ba16-431d-a4b0-a76a4e13c595]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2be06e-0ab5-4cb9-aac0-89ff5643181c]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaXgiKyH {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaXgiKyH" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[70341338-036e-4063-bc31-141734137424]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YaXgiKyH'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdef834-5b5f-4058-870b-bf2c4281a7c7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2da052-3af1-4ceb-8f5c-9cb01abcb5e2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b956fd-f33f-4e0a-8ae6-7e21f910f4a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]
Nov 15 12:51:34 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.
Nov 15 12:51:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8e48ac-b6a8-4456-9415-b1e9df3c3610]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeaab5d-60f0-44bc-ab20-9b5ca9f8aa28]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:51:34 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cfd91f-230f-4014-b515-d1eb995576f2]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:51:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaXgiKyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:51:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26437333230363764', 'path': '/dev/sdf'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437333230363764', 'path': '/dev/sdf'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:51:35 user nova-compute[75813]: DEBUG nova.objects.instance [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lazy-loading 'flavor' on Instance uuid 36b32262-4ea0-4a33-9672-82c7b8061bb1 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:51:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:51:35 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:51:35 user nova-compute[75813]:   <source dev="/dev/sdf"/>
Nov 15 12:51:35 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:51:35 user nova-compute[75813]:   <serial>2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda</serial>
Nov 15 12:51:35 user nova-compute[75813]: </disk>
Nov 15 12:51:35 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:51:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:51:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:51:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] No VIF found with MAC fa:16:3e:b7:0c:d8, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:51:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bab915e6-6861-4625-befc-0a5dfd530955 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.728s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:36 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:51:36 user nova-compute[75813]: DEBUG nova.compute.manager [req-912954ee-1ade-4d73-9757-4946557f2b75 req-72cc1e6e-ae3f-441b-b953-691d4b57657d service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Received event network-changed-89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:36 user nova-compute[75813]: DEBUG nova.compute.manager [req-912954ee-1ade-4d73-9757-4946557f2b75 req-72cc1e6e-ae3f-441b-b953-691d4b57657d service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Refreshing instance network info cache due to event network-changed-89a522a0-b643-4aae-be18-487bc2d1da47. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:51:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-912954ee-1ade-4d73-9757-4946557f2b75 req-72cc1e6e-ae3f-441b-b953-691d4b57657d service nova] Acquiring lock "refresh_cache-d5a3f7e0-b467-4653-894e-7a5f11c9b971" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-912954ee-1ade-4d73-9757-4946557f2b75 req-72cc1e6e-ae3f-441b-b953-691d4b57657d service nova] Acquired lock "refresh_cache-d5a3f7e0-b467-4653-894e-7a5f11c9b971" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:36 user nova-compute[75813]: DEBUG nova.network.neutron [req-912954ee-1ade-4d73-9757-4946557f2b75 req-72cc1e6e-ae3f-441b-b953-691d4b57657d service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Refreshing network info cache for port 89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:37 user nova-compute[75813]: INFO nova.compute.manager [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Terminating instance
Nov 15 12:51:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG nova.network.neutron [req-912954ee-1ade-4d73-9757-4946557f2b75 req-72cc1e6e-ae3f-441b-b953-691d4b57657d service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Updated VIF entry in instance network info cache for port 89a522a0-b643-4aae-be18-487bc2d1da47. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG nova.network.neutron [req-912954ee-1ade-4d73-9757-4946557f2b75 req-72cc1e6e-ae3f-441b-b953-691d4b57657d service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Updating instance_info_cache with network_info: [{"id": "89a522a0-b643-4aae-be18-487bc2d1da47", "address": "fa:16:3e:4c:36:d2", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a522a0-b6", "ovs_interfaceid": "89a522a0-b643-4aae-be18-487bc2d1da47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-912954ee-1ade-4d73-9757-4946557f2b75 req-72cc1e6e-ae3f-441b-b953-691d4b57657d service nova] Releasing lock "refresh_cache-d5a3f7e0-b467-4653-894e-7a5f11c9b971" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-e5dc2022-3b1e-4aab-b143-40bedd7b59f1 req-38db6c6b-9087-4814-bc38-f9782de363e3 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Received event network-vif-unplugged-89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e5dc2022-3b1e-4aab-b143-40bedd7b59f1 req-38db6c6b-9087-4814-bc38-f9782de363e3 service nova] Acquiring lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e5dc2022-3b1e-4aab-b143-40bedd7b59f1 req-38db6c6b-9087-4814-bc38-f9782de363e3 service nova] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e5dc2022-3b1e-4aab-b143-40bedd7b59f1 req-38db6c6b-9087-4814-bc38-f9782de363e3 service nova] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-e5dc2022-3b1e-4aab-b143-40bedd7b59f1 req-38db6c6b-9087-4814-bc38-f9782de363e3 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] No waiting events found dispatching network-vif-unplugged-89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-e5dc2022-3b1e-4aab-b143-40bedd7b59f1 req-38db6c6b-9087-4814-bc38-f9782de363e3 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Received event network-vif-unplugged-89a522a0-b643-4aae-be18-487bc2d1da47 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:51:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Instance destroyed successfully.
Nov 15 12:51:38 user nova-compute[75813]: DEBUG nova.objects.instance [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'resources' on Instance uuid d5a3f7e0-b467-4653-894e-7a5f11c9b971 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1551187316',display_name='tempest-AttachVolumeNegativeTest-server-1551187316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1551187316',id=11,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgPVVfO8wR9IJ0IF63tQcKXX0ONdo47kl95Ew+afbcOnrtgEwLnSU7UMAH9huOm9t3BlQ/moM1a0tXyHT4v02wfBBnUP5qOGIreHc2DDAl6uDKl//wR7+N+ORIKRqjNEQ==',key_name='tempest-keypair-1851397636',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:49:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-p82s8rjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=d5a3f7e0-b467-4653-894e-7a5f11c9b971,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89a522a0-b643-4aae-be18-487bc2d1da47", "address": "fa:16:3e:4c:36:d2", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a522a0-b6", "ovs_interfaceid": "89a522a0-b643-4aae-be18-487bc2d1da47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "89a522a0-b643-4aae-be18-487bc2d1da47", "address": "fa:16:3e:4c:36:d2", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a522a0-b6", "ovs_interfaceid": "89a522a0-b643-4aae-be18-487bc2d1da47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:36:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a522a0-b643-4aae-be18-487bc2d1da47,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a522a0-b6') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG os_vif [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:36:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a522a0-b643-4aae-be18-487bc2d1da47,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a522a0-b6') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89a522a0-b6, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a300267-b18f-4040-979f-7579fac323e2) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:38 user nova-compute[75813]: INFO os_vif [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:36:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a522a0-b643-4aae-be18-487bc2d1da47,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a522a0-b6')
Nov 15 12:51:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Deleting instance files /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971_del
Nov 15 12:51:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Deletion of /opt/stack/data/nova/instances/d5a3f7e0-b467-4653-894e-7a5f11c9b971_del complete
Nov 15 12:51:38 user nova-compute[75813]: INFO nova.compute.manager [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 12:51:38 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:51:38 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating instance_info_cache with network_info: [{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-5ff85a28-f09d-4bee-a05d-29f793481707 req-7caabb1c-8778-42ee-8316-f08223fb7ae3 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Received event network-vif-deleted-89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:39 user nova-compute[75813]: INFO nova.compute.manager [req-5ff85a28-f09d-4bee-a05d-29f793481707 req-7caabb1c-8778-42ee-8316-f08223fb7ae3 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Neutron deleted interface 89a522a0-b643-4aae-be18-487bc2d1da47; detaching it from the instance and deleting it from the info cache
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.network.neutron [req-5ff85a28-f09d-4bee-a05d-29f793481707 req-7caabb1c-8778-42ee-8316-f08223fb7ae3 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:39 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Took 1.04 seconds to deallocate network for instance.
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-5ff85a28-f09d-4bee-a05d-29f793481707 req-7caabb1c-8778-42ee-8316-f08223fb7ae3 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Detach interface failed, port_id=89a522a0-b643-4aae-be18-487bc2d1da47, reason: Instance d5a3f7e0-b467-4653-894e-7a5f11c9b971 could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Stashing vm_state: active {{(pid=75813) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.112s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:51:39 user nova-compute[75813]: INFO nova.compute.claims [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Claim successful on node user
Nov 15 12:51:39 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Deleted allocations for instance d5a3f7e0-b467-4653-894e-7a5f11c9b971
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:39 user nova-compute[75813]: INFO nova.compute.resource_tracker [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating resource usage from migration d4a2e336-0ebe-44c9-91be-a231e9d41f82
Nov 15 12:51:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ad13a57b-f88f-44d4-82e4-e5b80ee7fc18 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.594s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-c07e78fd-73b0-4156-8fdf-a984cbd33c29 req-616fc575-0005-4ce4-98fc-4b41e8e477c0 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Received event network-vif-plugged-89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c07e78fd-73b0-4156-8fdf-a984cbd33c29 req-616fc575-0005-4ce4-98fc-4b41e8e477c0 service nova] Acquiring lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c07e78fd-73b0-4156-8fdf-a984cbd33c29 req-616fc575-0005-4ce4-98fc-4b41e8e477c0 service nova] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c07e78fd-73b0-4156-8fdf-a984cbd33c29 req-616fc575-0005-4ce4-98fc-4b41e8e477c0 service nova] Lock "d5a3f7e0-b467-4653-894e-7a5f11c9b971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-c07e78fd-73b0-4156-8fdf-a984cbd33c29 req-616fc575-0005-4ce4-98fc-4b41e8e477c0 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] No waiting events found dispatching network-vif-plugged-89a522a0-b643-4aae-be18-487bc2d1da47 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:40 user nova-compute[75813]: WARNING nova.compute.manager [req-c07e78fd-73b0-4156-8fdf-a984cbd33c29 req-616fc575-0005-4ce4-98fc-4b41e8e477c0 service nova] [instance: d5a3f7e0-b467-4653-894e-7a5f11c9b971] Received unexpected event network-vif-plugged-89a522a0-b643-4aae-be18-487bc2d1da47 for instance with vm_state deleted and task_state None.
Nov 15 12:51:40 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.432s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:40 user nova-compute[75813]: INFO nova.compute.manager [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Migrating
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:40 user nova-compute[75813]: INFO nova.compute.rpcapi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquired lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:51:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:41 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:51:41 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.53548812866211GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Applying migration context for instance 36b32262-4ea0-4a33-9672-82c7b8061bb1 as it has an incoming, in-progress migration d4a2e336-0ebe-44c9-91be-a231e9d41f82. Migration status is pre-migrating {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 12:51:41 user nova-compute[75813]: INFO nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating resource usage from migration d4a2e336-0ebe-44c9-91be-a231e9d41f82
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 870cf760-ae0c-4df1-99cf-6403d8e642ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Migration d4a2e336-0ebe-44c9-91be-a231e9d41f82 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 36b32262-4ea0-4a33-9672-82c7b8061bb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=23GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating instance_info_cache with network_info: [{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Releasing lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Starting migrate_disk_and_power_off {{(pid=75813) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-ea3a23f2-b9cf-4e11-9160-9875c8f07f06 req-24001863-562d-4474-a82f-8127db98bdc3 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-unplugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ea3a23f2-b9cf-4e11-9160-9875c8f07f06 req-24001863-562d-4474-a82f-8127db98bdc3 service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ea3a23f2-b9cf-4e11-9160-9875c8f07f06 req-24001863-562d-4474-a82f-8127db98bdc3 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ea3a23f2-b9cf-4e11-9160-9875c8f07f06 req-24001863-562d-4474-a82f-8127db98bdc3 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-ea3a23f2-b9cf-4e11-9160-9875c8f07f06 req-24001863-562d-4474-a82f-8127db98bdc3 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-unplugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:42 user nova-compute[75813]: WARNING nova.compute.manager [req-ea3a23f2-b9cf-4e11-9160-9875c8f07f06 req-24001863-562d-4474-a82f-8127db98bdc3 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received unexpected event network-vif-unplugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with vm_state active and task_state resize_migrating.
Nov 15 12:51:43 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance destroyed successfully.
Nov 15 12:51:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1881026575',display_name='tempest-ServerActionsTestOtherB-server-1881026575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1881026575',id=4,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnZCP66OrHRDZ3ufYGtTWYdbRBSuBJje4iccBj6qLgISdaiqkf+oj6TVWJiVhyyqw9aCzwVAnqyqjl+t9sQMq2PFBTOdf/G6orxxQMji4Jiz+kT9TtRhqkc6tVuBEXETA==',key_name='tempest-keypair-296274020',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44e4af021f9f4272a0bf0f4f35e9d65a',ramdisk_id='',reservation_id='r-32pd9cde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1149556653',owner_user_name='tempest-ServerActionsTestOtherB-1149556653-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfabcfa53a840b68e154b271703efe7',uuid=36b32262-4ea0-4a33-9672-82c7b8061bb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1897040021-network", "vif_mac": "fa:16:3e:b7:0c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converting VIF {"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1897040021-network", "vif_mac": "fa:16:3e:b7:0c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_vif [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d4549cc-1d, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9ba5edf-4a7e-4cd4-bd17-86b02a9cda68) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:43 user nova-compute[75813]: INFO os_vif [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d')
Nov 15 12:51:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaXgiKyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:43 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd2c361-4505-489d-9646-ed8c1e4908f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:51:43 user nova-compute[75813]: No targets found.
Nov 15 12:51:43 user nova-compute[75813]: iSNS:
Nov 15 12:51:43 user nova-compute[75813]: No targets found.
Nov 15 12:51:43 user nova-compute[75813]: STATIC:
Nov 15 12:51:43 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69
Nov 15 12:51:43 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:51:43 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:51:43 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357
Nov 15 12:51:43 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:51:43 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:51:43 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6
Nov 15 12:51:43 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:51:43 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:51:43 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:51:43 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:51:43 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:51:43 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483
Nov 15 12:51:43 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:51:43 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:51:43 user nova-compute[75813]: FIRMWARE:
Nov 15 12:51:43 user nova-compute[75813]: No targets found.
Nov 15 12:51:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:51:43 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:51:43 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21a83be-ba17-4683-bba0-07e95b518be0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1015d1-257f-405b-b141-7ccf4334f40e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:43 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:43 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:43 user nova-compute[75813]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:51:43 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:43 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:43 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:43 user nova-compute[75813]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:51:43 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555023b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda'): ({'sdf'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Removing single pathed devices sdf {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae41ecb-8930-4d4b-8c9d-8beba3d73b1d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fe0881-7320-4f56-8c5b-7f6c8b5e42fa]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Flushing IO for device /dev/sdf {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98c7442-facd-4ef1-bcea-2174013f6ff8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae7adc4-f14e-4824-8a19-5c89bf76a109]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a4cdc4-2734-4346-8be2-ee0e1f1fa8b0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c35b73-f5ea-469f-9220-028014b559fc]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]
Nov 15 12:51:43 user nova-compute[75813]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.
Nov 15 12:51:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d673e9-006d-4a8e-ab71-560193b792cb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] <== disconnect_volume: return (321ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:51:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1_resize/disk /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "cp -r /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1_resize/disk /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk" returned: 0 in 0.407s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1_resize/disk.info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk.info {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "cp -r /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1_resize/disk.info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk.info" returned: 0 in 0.031s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-c00e3164-25c6-45ed-9931-f24c888aa00f req-5571d48b-59cb-4cfa-bcad-666d7bf344cb service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c00e3164-25c6-45ed-9931-f24c888aa00f req-5571d48b-59cb-4cfa-bcad-666d7bf344cb service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c00e3164-25c6-45ed-9931-f24c888aa00f req-5571d48b-59cb-4cfa-bcad-666d7bf344cb service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c00e3164-25c6-45ed-9931-f24c888aa00f req-5571d48b-59cb-4cfa-bcad-666d7bf344cb service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-c00e3164-25c6-45ed-9931-f24c888aa00f req-5571d48b-59cb-4cfa-bcad-666d7bf344cb service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:44 user nova-compute[75813]: WARNING nova.compute.manager [req-c00e3164-25c6-45ed-9931-f24c888aa00f req-5571d48b-59cb-4cfa-bcad-666d7bf344cb service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received unexpected event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with vm_state active and task_state resize_migrating.
Nov 15 12:51:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Port 1d4549cc-1d5a-4548-86d8-1832e8ce3d4c binding to destination host user is already ACTIVE {{(pid=75813) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 12:51:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquired lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating instance_info_cache with network_info: [{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Releasing lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG os_brick.utils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fad7d96-a069-4778-98cb-a23339863f69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bea808-2e76-44f5-be54-a763674bdae4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c194d52-86d1-40c8-8f21-4f63f668979a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48bc1f1-2b01-4ab4-9e5e-b997e97f2959]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:46 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:51:46 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88bc042-f085-403e-a19b-319ecc77fcd3]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:51:46 user nova-compute[75813]: DEBUG os_brick.utils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:51:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:51:47 user nova-compute[75813]: INFO nova.compute.claims [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Claim successful on node user
Nov 15 12:51:48 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG nova.network.neutron [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:51:48 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:51:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG nova.policy [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a5b1f2549c9478d8fb22044280d6e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd8b6a5e5b4b1a912b5292a82ab229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:51:48 user nova-compute[75813]: INFO nova.virt.block_device [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Booting with volume ced25d20-b388-4c9f-9936-ba1f29755c62 at /dev/vda
Nov 15 12:51:48 user nova-compute[75813]: DEBUG os_brick.utils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cc168e-d0d5-45e7-9619-32b6cea9482f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e95a099-8ef2-43ce-ab02-d45b1ab5e287]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6f88b6-c2e1-4e2f-a1e4-90f68829407d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[03915556-214d-4d67-a1a5-d386d867aafb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:51:48 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:51:48 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dbb1c4-a1db-453e-8cf5-da45e5d94b09]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG os_brick.utils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:48 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Updating existing volume attachment record: 63c7b75e-c3b7-4904-a236-571f5a8a7e14 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:51:49 user nova-compute[75813]: DEBUG nova.network.neutron [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Successfully created port: c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:51:49 user nova-compute[75813]: DEBUG nova.network.neutron [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Successfully updated port: c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:51:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "refresh_cache-c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquired lock "refresh_cache-c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:49 user nova-compute[75813]: DEBUG nova.network.neutron [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:51:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-6816c067-7165-4df7-8f13-bfd8b86af1b1 req-b3b16700-ecfa-4cfa-b78f-f78865da2cd7 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-changed-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-6816c067-7165-4df7-8f13-bfd8b86af1b1 req-b3b16700-ecfa-4cfa-b78f-f78865da2cd7 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Refreshing instance network info cache due to event network-changed-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:51:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6816c067-7165-4df7-8f13-bfd8b86af1b1 req-b3b16700-ecfa-4cfa-b78f-f78865da2cd7 service nova] Acquiring lock "refresh_cache-c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:51:49 user nova-compute[75813]: DEBUG nova.network.neutron [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:51:50 user nova-compute[75813]: DEBUG nova.network.neutron [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Updating instance_info_cache with network_info: [{"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Releasing lock "refresh_cache-c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Instance network_info: |[{"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:51:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6816c067-7165-4df7-8f13-bfd8b86af1b1 req-b3b16700-ecfa-4cfa-b78f-f78865da2cd7 service nova] Acquired lock "refresh_cache-c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:51:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-6816c067-7165-4df7-8f13-bfd8b86af1b1 req-b3b16700-ecfa-4cfa-b78f-f78865da2cd7 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Refreshing network info cache for port c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:51:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-6816c067-7165-4df7-8f13-bfd8b86af1b1 req-b3b16700-ecfa-4cfa-b78f-f78865da2cd7 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Updated VIF entry in instance network info cache for port c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:51:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-6816c067-7165-4df7-8f13-bfd8b86af1b1 req-b3b16700-ecfa-4cfa-b78f-f78865da2cd7 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Updating instance_info_cache with network_info: [{"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:51:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6816c067-7165-4df7-8f13-bfd8b86af1b1 req-b3b16700-ecfa-4cfa-b78f-f78865da2cd7 service nova] Releasing lock "refresh_cache-c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Starting finish_migration {{(pid=75813) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance directory exists: not creating {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 12:51:52 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Creating image(s)
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk. size=21474836480 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk 21474836480 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk 21474836480" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Ensure instance console log exists: /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Start _get_guest_xml network_info=[{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1897040021-network", "vif_mac": "fa:16:3e:b7:0c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '7f4217c8-f0c9-477f-ad88-490d73b3dccc', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaXgiKyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '36b32262-4ea0-4a33-9672-82c7b8061bb1', 'attached_at': '2023-11-15T12:51:52.000000', 'detached_at': '', 'volume_id': '2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'serial': '2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:51:52 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:51:52 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaXgiKyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:52 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:52 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:52 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f6f148-c8e7-4bf8-b301-c1f969d918dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:51:52 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2581f2-88b9-4fb3-b2c5-2618249c03fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda] added
Nov 15 12:51:52 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[046a94f4-b28b-4dfa-ac66-28c88325a3a7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6360a3b-ef29-4d5c-a0cd-7ed9a76d5645]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaXgiKyH {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaXgiKyH" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[28066263-9a13-4049-8e93-e0d0131baba2]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YaXgiKyH'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[67060601-8228-444e-a8c0-86e42dce1228]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea702839-4893-45f6-ad5f-cca4e4112b97]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:52 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:52 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:52 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:52 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:52 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:52 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:52 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:52 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da30a9a-9bc2-4453-9caa-4c6e87fde1b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]
Nov 15 12:51:53 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.
Nov 15 12:51:53 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[06821615-2cb7-435f-8d52-92c61230ca4a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa231b3-1b3f-4741-8650-b1f93ed491cf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:53 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:53 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:53 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:51:53 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:53 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:53 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:53 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:53 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:51:53 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:53 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[613ef6c5-ad84-4150-a893-ebed2e56d676]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaXgiKyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:51:53 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Creating image(s)
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Ensure instance console log exists: /opt/stack/data/nova/instances/c15606eb-006c-4a2d-9f2b-a4cc69cc6f19/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Start _get_guest_xml network_info=[{"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '63c7b75e-c3b7-4904-a236-571f5a8a7e14', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjbkhYZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c15606eb-006c-4a2d-9f2b-a4cc69cc6f19', 'attached_at': '', 'detached_at': '', 'volume_id': 'ced25d20-b388-4c9f-9936-ba1f29755c62', 'serial': 'ced25d20-b388-4c9f-9936-ba1f29755c62'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:51:53 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:51:53 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjbkhYZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:51:53 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26437333230363764', 'path': '/dev/sdf'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437333230363764', 'path': '/dev/sdf'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.255s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:54 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:51:54 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df304c2-9b57-41ee-a769-6cbe6990b379]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:51:54 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1881026575',display_name='tempest-ServerActionsTestOtherB-server-1881026575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1881026575',id=4,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnZCP66OrHRDZ3ufYGtTWYdbRBSuBJje4iccBj6qLgISdaiqkf+oj6TVWJiVhyyqw9aCzwVAnqyqjl+t9sQMq2PFBTOdf/G6orxxQMji4Jiz+kT9TtRhqkc6tVuBEXETA==',key_name='tempest-keypair-296274020',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44e4af021f9f4272a0bf0f4f35e9d65a',ramdisk_id='',reservation_id='r-32pd9cde',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1149556653',owner_user_name='tempest-ServerActionsTestOtherB-1149556653-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfabcfa53a840b68e154b271703efe7',uuid=36b32262-4ea0-4a33-9672-82c7b8061bb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1897040021-network", "vif_mac": "fa:16:3e:b7:0c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converting VIF {"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1897040021-network", "vif_mac": "fa:16:3e:b7:0c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:51:54 user nova-compute[75813]:   <uuid>36b32262-4ea0-4a33-9672-82c7b8061bb1</uuid>
Nov 15 12:51:54 user nova-compute[75813]:   <name>instance-00000004</name>
Nov 15 12:51:54 user nova-compute[75813]:   <memory>2097152</memory>
Nov 15 12:51:54 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:51:54 user nova-compute[75813]:   <metadata>
Nov 15 12:51:54 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:51:54 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:51:54 user nova-compute[75813]:       <nova:name>tempest-ServerActionsTestOtherB-server-1881026575</nova:name>
Nov 15 12:51:54 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:51:52</nova:creationTime>
Nov 15 12:51:54 user nova-compute[75813]:       <nova:flavor name="m1.small">
Nov 15 12:51:54 user nova-compute[75813]:         <nova:memory>2048</nova:memory>
Nov 15 12:51:54 user nova-compute[75813]:         <nova:disk>20</nova:disk>
Nov 15 12:51:54 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:51:54 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:51:54 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:51:54 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:51:54 user nova-compute[75813]:       <nova:owner>
Nov 15 12:51:54 user nova-compute[75813]:         <nova:user uuid="bcfabcfa53a840b68e154b271703efe7">tempest-ServerActionsTestOtherB-1149556653-project-member</nova:user>
Nov 15 12:51:54 user nova-compute[75813]:         <nova:project uuid="44e4af021f9f4272a0bf0f4f35e9d65a">tempest-ServerActionsTestOtherB-1149556653</nova:project>
Nov 15 12:51:54 user nova-compute[75813]:       </nova:owner>
Nov 15 12:51:54 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:51:54 user nova-compute[75813]:       <nova:ports>
Nov 15 12:51:54 user nova-compute[75813]:         <nova:port uuid="1d4549cc-1d5a-4548-86d8-1832e8ce3d4c">
Nov 15 12:51:54 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 12:51:54 user nova-compute[75813]:         </nova:port>
Nov 15 12:51:54 user nova-compute[75813]:       </nova:ports>
Nov 15 12:51:54 user nova-compute[75813]:     </nova:instance>
Nov 15 12:51:54 user nova-compute[75813]:   </metadata>
Nov 15 12:51:54 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:51:54 user nova-compute[75813]:     <system>
Nov 15 12:51:54 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:51:54 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:51:54 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:51:54 user nova-compute[75813]:       <entry name="serial">36b32262-4ea0-4a33-9672-82c7b8061bb1</entry>
Nov 15 12:51:54 user nova-compute[75813]:       <entry name="uuid">36b32262-4ea0-4a33-9672-82c7b8061bb1</entry>
Nov 15 12:51:54 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:51:54 user nova-compute[75813]:     </system>
Nov 15 12:51:54 user nova-compute[75813]:   </sysinfo>
Nov 15 12:51:54 user nova-compute[75813]:   <os>
Nov 15 12:51:54 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:51:54 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:51:54 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:51:54 user nova-compute[75813]:   </os>
Nov 15 12:51:54 user nova-compute[75813]:   <features>
Nov 15 12:51:54 user nova-compute[75813]:     <acpi/>
Nov 15 12:51:54 user nova-compute[75813]:     <apic/>
Nov 15 12:51:54 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:51:54 user nova-compute[75813]:   </features>
Nov 15 12:51:54 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:51:54 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:51:54 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:51:54 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:51:54 user nova-compute[75813]:   </clock>
Nov 15 12:51:54 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:51:54 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:51:54 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:51:54 user nova-compute[75813]:   </cpu>
Nov 15 12:51:54 user nova-compute[75813]:   <devices>
Nov 15 12:51:54 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:51:54 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:51:54 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk"/>
Nov 15 12:51:54 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:51:54 user nova-compute[75813]:     </disk>
Nov 15 12:51:54 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 12:51:54 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:51:54 user nova-compute[75813]:       <source dev="/dev/sdf"/>
Nov 15 12:51:54 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 12:51:54 user nova-compute[75813]:       <serial>2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda</serial>
Nov 15 12:51:54 user nova-compute[75813]:     </disk>
Nov 15 12:51:54 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:51:54 user nova-compute[75813]:       <mac address="fa:16:3e:b7:0c:d8"/>
Nov 15 12:51:54 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:54 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:51:54 user nova-compute[75813]:       <target dev="tap1d4549cc-1d"/>
Nov 15 12:51:54 user nova-compute[75813]:     </interface>
Nov 15 12:51:54 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:51:54 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/console.log" append="off"/>
Nov 15 12:51:54 user nova-compute[75813]:     </serial>
Nov 15 12:51:54 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:51:54 user nova-compute[75813]:     <video>
Nov 15 12:51:54 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:54 user nova-compute[75813]:     </video>
Nov 15 12:51:54 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:51:54 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:51:54 user nova-compute[75813]:     </rng>
Nov 15 12:51:54 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:51:54 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:51:54 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:51:54 user nova-compute[75813]:     </memballoon>
Nov 15 12:51:54 user nova-compute[75813]:   </devices>
Nov 15 12:51:54 user nova-compute[75813]: </domain>
Nov 15 12:51:54 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1881026575',display_name='tempest-ServerActionsTestOtherB-server-1881026575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1881026575',id=4,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnZCP66OrHRDZ3ufYGtTWYdbRBSuBJje4iccBj6qLgISdaiqkf+oj6TVWJiVhyyqw9aCzwVAnqyqjl+t9sQMq2PFBTOdf/G6orxxQMji4Jiz+kT9TtRhqkc6tVuBEXETA==',key_name='tempest-keypair-296274020',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44e4af021f9f4272a0bf0f4f35e9d65a',ramdisk_id='',reservation_id='r-32pd9cde',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1149556653',owner_user_name='tempest-ServerActionsTestOtherB-1149556653-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfabcfa53a840b68e154b271703efe7',uuid=36b32262-4ea0-4a33-9672-82c7b8061bb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1897040021-network", "vif_mac": "fa:16:3e:b7:0c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converting VIF {"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1897040021-network", "vif_mac": "fa:16:3e:b7:0c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_vif [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf866292-fe90-4d9c-86db-49e6a70c8fc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '375affc4-2f58-5c8c-a7b6-868eec2195d4', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62] added
Nov 15 12:51:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d4549cc-1d, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d4549cc-1d, col_values=(('qos', UUID('f75b6cd5-acf4-4a0a-b95a-4c697239ac06')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d4549cc-1d, col_values=(('external_ids', {'iface-id': '1d4549cc-1d5a-4548-86d8-1832e8ce3d4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:0c:d8', 'vm-uuid': '36b32262-4ea0-4a33-9672-82c7b8061bb1'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a62724b-4f17-4b41-b270-2a58578d477f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:54 user nova-compute[75813]: INFO os_vif [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d')
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6650eef6-e216-4cb5-8d7a-f6bb55258d24]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjbkhYZG {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjbkhYZG" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb28d65-911f-4dfa-9ac7-7bcbb3a8b18e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjbkhYZG'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] No VIF found with MAC fa:16:3e:b7:0c:d8, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6d3ba4-d893-4c24-9b51-44b3447f2792]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac2065c-019e-4057-b722-006ebb33c14a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c95d684-19d4-428f-b062-32a42327c8d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260]
Nov 15 12:51:54 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260] successful.
Nov 15 12:51:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7582afc4-f404-4c92-bf20-066f1e554178]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f20e63-cceb-4582-8615-4b55c0e001eb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:51:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] HCTL ('38', '-', '-', 0) found on session 16 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc6f3e5-f0e5-447f-94a2-2f61a34a87ab]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Searching for a device in session 16 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:51:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjbkhYZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] <== connect_volume: return (1636ms) {'type': 'block', 'scsi_wwn': '23639313466333938', 'path': '/dev/sdg'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639313466333938', 'path': '/dev/sdg'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-993680613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-993680613',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb/l5B2mNfvx3ejegALfCADApCPXkMgdnx4hiGlUk/k53ie1STpv9BkOk5dWVF/By6Oa+EXAiTFeu+O7HTaL+818YoX/tvMZolR8+GdK0FQFNb1pM3ypmccc7h/vvqoMQ==',key_name='tempest-keypair-1925599135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73fd8b6a5e5b4b1a912b5292a82ab229',ramdisk_id='',reservation_id='r-1riwgsxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1768863154',owner_user_name='tempest-ServerActionsV293TestJSON-1768863154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5b1f2549c9478d8fb22044280d6e9e',uuid=c15606eb-006c-4a2d-9f2b-a4cc69cc6f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converting VIF {"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG nova.objects.instance [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lazy-loading 'pci_devices' on Instance uuid c15606eb-006c-4a2d-9f2b-a4cc69cc6f19 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:51:55 user nova-compute[75813]:   <uuid>c15606eb-006c-4a2d-9f2b-a4cc69cc6f19</uuid>
Nov 15 12:51:55 user nova-compute[75813]:   <name>instance-0000000d</name>
Nov 15 12:51:55 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:51:55 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:51:55 user nova-compute[75813]:   <metadata>
Nov 15 12:51:55 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:51:55 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:51:55 user nova-compute[75813]:       <nova:name>tempest-ServerActionsV293TestJSON-server-993680613</nova:name>
Nov 15 12:51:55 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:51:53</nova:creationTime>
Nov 15 12:51:55 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:51:55 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:51:55 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:51:55 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:51:55 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:51:55 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:51:55 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:51:55 user nova-compute[75813]:       <nova:owner>
Nov 15 12:51:55 user nova-compute[75813]:         <nova:user uuid="8a5b1f2549c9478d8fb22044280d6e9e">tempest-ServerActionsV293TestJSON-1768863154-project-member</nova:user>
Nov 15 12:51:55 user nova-compute[75813]:         <nova:project uuid="73fd8b6a5e5b4b1a912b5292a82ab229">tempest-ServerActionsV293TestJSON-1768863154</nova:project>
Nov 15 12:51:55 user nova-compute[75813]:       </nova:owner>
Nov 15 12:51:55 user nova-compute[75813]:       <nova:ports>
Nov 15 12:51:55 user nova-compute[75813]:         <nova:port uuid="c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe">
Nov 15 12:51:55 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 12:51:55 user nova-compute[75813]:         </nova:port>
Nov 15 12:51:55 user nova-compute[75813]:       </nova:ports>
Nov 15 12:51:55 user nova-compute[75813]:     </nova:instance>
Nov 15 12:51:55 user nova-compute[75813]:   </metadata>
Nov 15 12:51:55 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:51:55 user nova-compute[75813]:     <system>
Nov 15 12:51:55 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:51:55 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:51:55 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:51:55 user nova-compute[75813]:       <entry name="serial">c15606eb-006c-4a2d-9f2b-a4cc69cc6f19</entry>
Nov 15 12:51:55 user nova-compute[75813]:       <entry name="uuid">c15606eb-006c-4a2d-9f2b-a4cc69cc6f19</entry>
Nov 15 12:51:55 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:51:55 user nova-compute[75813]:     </system>
Nov 15 12:51:55 user nova-compute[75813]:   </sysinfo>
Nov 15 12:51:55 user nova-compute[75813]:   <os>
Nov 15 12:51:55 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:51:55 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:51:55 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:51:55 user nova-compute[75813]:   </os>
Nov 15 12:51:55 user nova-compute[75813]:   <features>
Nov 15 12:51:55 user nova-compute[75813]:     <acpi/>
Nov 15 12:51:55 user nova-compute[75813]:     <apic/>
Nov 15 12:51:55 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:51:55 user nova-compute[75813]:   </features>
Nov 15 12:51:55 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:51:55 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:51:55 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:51:55 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:51:55 user nova-compute[75813]:   </clock>
Nov 15 12:51:55 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:51:55 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:51:55 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:51:55 user nova-compute[75813]:   </cpu>
Nov 15 12:51:55 user nova-compute[75813]:   <devices>
Nov 15 12:51:55 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 12:51:55 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:51:55 user nova-compute[75813]:       <source dev="/dev/sdg"/>
Nov 15 12:51:55 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:51:55 user nova-compute[75813]:       <serial>ced25d20-b388-4c9f-9936-ba1f29755c62</serial>
Nov 15 12:51:55 user nova-compute[75813]:     </disk>
Nov 15 12:51:55 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:51:55 user nova-compute[75813]:       <mac address="fa:16:3e:d6:3f:4d"/>
Nov 15 12:51:55 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:55 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:51:55 user nova-compute[75813]:       <target dev="tapc4b9b70a-52"/>
Nov 15 12:51:55 user nova-compute[75813]:     </interface>
Nov 15 12:51:55 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:51:55 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/c15606eb-006c-4a2d-9f2b-a4cc69cc6f19/console.log" append="off"/>
Nov 15 12:51:55 user nova-compute[75813]:     </serial>
Nov 15 12:51:55 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:51:55 user nova-compute[75813]:     <video>
Nov 15 12:51:55 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:51:55 user nova-compute[75813]:     </video>
Nov 15 12:51:55 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:51:55 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:51:55 user nova-compute[75813]:     </rng>
Nov 15 12:51:55 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:51:55 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:51:55 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:51:55 user nova-compute[75813]:     </memballoon>
Nov 15 12:51:55 user nova-compute[75813]:   </devices>
Nov 15 12:51:55 user nova-compute[75813]: </domain>
Nov 15 12:51:55 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-993680613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-993680613',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb/l5B2mNfvx3ejegALfCADApCPXkMgdnx4hiGlUk/k53ie1STpv9BkOk5dWVF/By6Oa+EXAiTFeu+O7HTaL+818YoX/tvMZolR8+GdK0FQFNb1pM3ypmccc7h/vvqoMQ==',key_name='tempest-keypair-1925599135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73fd8b6a5e5b4b1a912b5292a82ab229',ramdisk_id='',reservation_id='r-1riwgsxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1768863154',owner_user_name='tempest-ServerActionsV293TestJSON-1768863154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5b1f2549c9478d8fb22044280d6e9e',uuid=c15606eb-006c-4a2d-9f2b-a4cc69cc6f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converting VIF {"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG os_vif [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c94ac20-0ab9-56b4-a4e8-549d06224d2a', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4b9b70a-52, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4b9b70a-52, col_values=(('qos', UUID('554a28ef-51ff-4ad8-bc97-a347a3b6cdf2')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4b9b70a-52, col_values=(('external_ids', {'iface-id': 'c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:3f:4d', 'vm-uuid': 'c15606eb-006c-4a2d-9f2b-a4cc69cc6f19'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:55 user nova-compute[75813]: INFO os_vif [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52')
Nov 15 12:51:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:51:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] No VIF found with MAC fa:16:3e:d6:3f:4d, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:51:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-e87c1a5a-0cbc-42ad-ab16-199b613d8a60 req-2103ed00-1c27-48a6-8d33-fef949f72b38 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e87c1a5a-0cbc-42ad-ab16-199b613d8a60 req-2103ed00-1c27-48a6-8d33-fef949f72b38 service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e87c1a5a-0cbc-42ad-ab16-199b613d8a60 req-2103ed00-1c27-48a6-8d33-fef949f72b38 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e87c1a5a-0cbc-42ad-ab16-199b613d8a60 req-2103ed00-1c27-48a6-8d33-fef949f72b38 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-e87c1a5a-0cbc-42ad-ab16-199b613d8a60 req-2103ed00-1c27-48a6-8d33-fef949f72b38 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:56 user nova-compute[75813]: WARNING nova.compute.manager [req-e87c1a5a-0cbc-42ad-ab16-199b613d8a60 req-2103ed00-1c27-48a6-8d33-fef949f72b38 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received unexpected event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with vm_state active and task_state resize_finish.
Nov 15 12:51:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG nova.compute.manager [req-e6e0b431-b082-4989-84ce-fec795da7d9b req-7ee3cd1f-6dfd-4e5f-b126-3b1b43ec926a service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e6e0b431-b082-4989-84ce-fec795da7d9b req-7ee3cd1f-6dfd-4e5f-b126-3b1b43ec926a service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e6e0b431-b082-4989-84ce-fec795da7d9b req-7ee3cd1f-6dfd-4e5f-b126-3b1b43ec926a service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e6e0b431-b082-4989-84ce-fec795da7d9b req-7ee3cd1f-6dfd-4e5f-b126-3b1b43ec926a service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG nova.compute.manager [req-e6e0b431-b082-4989-84ce-fec795da7d9b req-7ee3cd1f-6dfd-4e5f-b126-3b1b43ec926a service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:57 user nova-compute[75813]: WARNING nova.compute.manager [req-e6e0b431-b082-4989-84ce-fec795da7d9b req-7ee3cd1f-6dfd-4e5f-b126-3b1b43ec926a service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received unexpected event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with vm_state building and task_state spawning.
Nov 15 12:51:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-ffbef652-89c5-47d9-91b6-32bb27679c78 req-49b114f2-a5e1-482f-a390-59417224c521 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ffbef652-89c5-47d9-91b6-32bb27679c78 req-49b114f2-a5e1-482f-a390-59417224c521 service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ffbef652-89c5-47d9-91b6-32bb27679c78 req-49b114f2-a5e1-482f-a390-59417224c521 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ffbef652-89c5-47d9-91b6-32bb27679c78 req-49b114f2-a5e1-482f-a390-59417224c521 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-ffbef652-89c5-47d9-91b6-32bb27679c78 req-49b114f2-a5e1-482f-a390-59417224c521 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:58 user nova-compute[75813]: WARNING nova.compute.manager [req-ffbef652-89c5-47d9-91b6-32bb27679c78 req-49b114f2-a5e1-482f-a390-59417224c521 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received unexpected event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with vm_state active and task_state resize_finish.
Nov 15 12:51:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:51:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance running successfully.
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Failed to set time: agent not configured {{(pid=75813) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52fbeffd-14df-4123-b891-4faf25a59b45 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] finish_migration finished successfully. {{(pid=75813) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.compute.manager [req-c2ca28de-f470-4b14-91d1-be5d465b7935 req-6dd89cb2-a69f-4fa6-a90d-b109130d6477 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2ca28de-f470-4b14-91d1-be5d465b7935 req-6dd89cb2-a69f-4fa6-a90d-b109130d6477 service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2ca28de-f470-4b14-91d1-be5d465b7935 req-6dd89cb2-a69f-4fa6-a90d-b109130d6477 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2ca28de-f470-4b14-91d1-be5d465b7935 req-6dd89cb2-a69f-4fa6-a90d-b109130d6477 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.compute.manager [req-c2ca28de-f470-4b14-91d1-be5d465b7935 req-6dd89cb2-a69f-4fa6-a90d-b109130d6477 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:51:59 user nova-compute[75813]: WARNING nova.compute.manager [req-c2ca28de-f470-4b14-91d1-be5d465b7935 req-6dd89cb2-a69f-4fa6-a90d-b109130d6477 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received unexpected event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with vm_state building and task_state spawning.
Nov 15 12:51:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Instance spawned successfully.
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:51:59 user nova-compute[75813]: INFO nova.compute.manager [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 15 12:51:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:52:00 user nova-compute[75813]: INFO nova.compute.manager [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Took 12.31 seconds to build instance.
Nov 15 12:52:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-27eba896-cd70-4497-9274-97ab0a6cd791 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.419s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:52:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:14 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:52:14 user nova-compute[75813]: INFO nova.compute.claims [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Claim successful on node user
Nov 15 12:52:14 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:52:14 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:52:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:52:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:52:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG nova.policy [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bf41fe4e06e4a0490cc6f9c20016d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a055627447c452fb366996320d60200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:52:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Creating image(s)
Nov 15 12:52:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "/opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "/opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "/opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk 1073741824" returned: 0 in 0.049s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Successfully created port: 56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Cannot resize image /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Ensure instance console log exists: /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Successfully updated port: 56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquired lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-5a369c08-bbcf-4e27-a135-3938cff1a63b req-e0e67524-fd70-46fc-8ae9-f3cc06cb95bc service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Received event network-changed-56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-5a369c08-bbcf-4e27-a135-3938cff1a63b req-e0e67524-fd70-46fc-8ae9-f3cc06cb95bc service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Refreshing instance network info cache due to event network-changed-56dea8af-36d1-4ec2-be04-65a386672144. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5a369c08-bbcf-4e27-a135-3938cff1a63b req-e0e67524-fd70-46fc-8ae9-f3cc06cb95bc service nova] Acquiring lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updating instance_info_cache with network_info: [{"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Releasing lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Instance network_info: |[{"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5a369c08-bbcf-4e27-a135-3938cff1a63b req-e0e67524-fd70-46fc-8ae9-f3cc06cb95bc service nova] Acquired lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.network.neutron [req-5a369c08-bbcf-4e27-a135-3938cff1a63b req-e0e67524-fd70-46fc-8ae9-f3cc06cb95bc service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Refreshing network info cache for port 56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Start _get_guest_xml network_info=[{"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:52:17 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:52:17 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1729100775',display_name='tempest-SnapshotDataIntegrityTests-server-1729100775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1729100775',id=14,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQpVW7V8D1oVJDvZhE5Sa0vrL/1BGVJ6plPh2XV9hLcruHRkjFO7AXATQprlS2lBxLqgnM5WIgdj25aU8UCesWpDei9kHOkRJtnIzUA9cko+BFcTsU7xIMlhTh5WjqQiw==',key_name='tempest-keypair-1558375347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a055627447c452fb366996320d60200',ramdisk_id='',reservation_id='r-9ed7vtiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-169717009',owner_user_name='tempest-SnapshotDataIntegrityTests-169717009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bf41fe4e06e4a0490cc6f9c20016d56',uuid=45154992-3213-43fa-89dc-d433f57ae978,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Converting VIF {"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:07:30,bridge_name='br-int',has_traffic_filtering=True,id=56dea8af-36d1-4ec2-be04-65a386672144,network=Network(e41d07f1-168e-4349-9ecb-e02dca523951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56dea8af-36') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'pci_devices' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:52:17 user nova-compute[75813]:   <uuid>45154992-3213-43fa-89dc-d433f57ae978</uuid>
Nov 15 12:52:17 user nova-compute[75813]:   <name>instance-0000000e</name>
Nov 15 12:52:17 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:52:17 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:52:17 user nova-compute[75813]:   <metadata>
Nov 15 12:52:17 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:52:17 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:52:17 user nova-compute[75813]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1729100775</nova:name>
Nov 15 12:52:17 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:52:17</nova:creationTime>
Nov 15 12:52:17 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:52:17 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:52:17 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:52:17 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:52:17 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:52:17 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:52:17 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:52:17 user nova-compute[75813]:       <nova:owner>
Nov 15 12:52:17 user nova-compute[75813]:         <nova:user uuid="8bf41fe4e06e4a0490cc6f9c20016d56">tempest-SnapshotDataIntegrityTests-169717009-project-member</nova:user>
Nov 15 12:52:17 user nova-compute[75813]:         <nova:project uuid="5a055627447c452fb366996320d60200">tempest-SnapshotDataIntegrityTests-169717009</nova:project>
Nov 15 12:52:17 user nova-compute[75813]:       </nova:owner>
Nov 15 12:52:17 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:52:17 user nova-compute[75813]:       <nova:ports>
Nov 15 12:52:17 user nova-compute[75813]:         <nova:port uuid="56dea8af-36d1-4ec2-be04-65a386672144">
Nov 15 12:52:17 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 12:52:17 user nova-compute[75813]:         </nova:port>
Nov 15 12:52:17 user nova-compute[75813]:       </nova:ports>
Nov 15 12:52:17 user nova-compute[75813]:     </nova:instance>
Nov 15 12:52:17 user nova-compute[75813]:   </metadata>
Nov 15 12:52:17 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:52:17 user nova-compute[75813]:     <system>
Nov 15 12:52:17 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:52:17 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:52:17 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:52:17 user nova-compute[75813]:       <entry name="serial">45154992-3213-43fa-89dc-d433f57ae978</entry>
Nov 15 12:52:17 user nova-compute[75813]:       <entry name="uuid">45154992-3213-43fa-89dc-d433f57ae978</entry>
Nov 15 12:52:17 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:52:17 user nova-compute[75813]:     </system>
Nov 15 12:52:17 user nova-compute[75813]:   </sysinfo>
Nov 15 12:52:17 user nova-compute[75813]:   <os>
Nov 15 12:52:17 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:52:17 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:52:17 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:52:17 user nova-compute[75813]:   </os>
Nov 15 12:52:17 user nova-compute[75813]:   <features>
Nov 15 12:52:17 user nova-compute[75813]:     <acpi/>
Nov 15 12:52:17 user nova-compute[75813]:     <apic/>
Nov 15 12:52:17 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:52:17 user nova-compute[75813]:   </features>
Nov 15 12:52:17 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:52:17 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:52:17 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:52:17 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:52:17 user nova-compute[75813]:   </clock>
Nov 15 12:52:17 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:52:17 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:52:17 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:52:17 user nova-compute[75813]:   </cpu>
Nov 15 12:52:17 user nova-compute[75813]:   <devices>
Nov 15 12:52:17 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:52:17 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:52:17 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk"/>
Nov 15 12:52:17 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:52:17 user nova-compute[75813]:     </disk>
Nov 15 12:52:17 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:52:17 user nova-compute[75813]:       <mac address="fa:16:3e:a5:07:30"/>
Nov 15 12:52:17 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:52:17 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:52:17 user nova-compute[75813]:       <target dev="tap56dea8af-36"/>
Nov 15 12:52:17 user nova-compute[75813]:     </interface>
Nov 15 12:52:17 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:52:17 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/console.log" append="off"/>
Nov 15 12:52:17 user nova-compute[75813]:     </serial>
Nov 15 12:52:17 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:52:17 user nova-compute[75813]:     <video>
Nov 15 12:52:17 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:52:17 user nova-compute[75813]:     </video>
Nov 15 12:52:17 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:52:17 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:52:17 user nova-compute[75813]:     </rng>
Nov 15 12:52:17 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:52:17 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:52:17 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:52:17 user nova-compute[75813]:     </memballoon>
Nov 15 12:52:17 user nova-compute[75813]:   </devices>
Nov 15 12:52:17 user nova-compute[75813]: </domain>
Nov 15 12:52:17 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1729100775',display_name='tempest-SnapshotDataIntegrityTests-server-1729100775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1729100775',id=14,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQpVW7V8D1oVJDvZhE5Sa0vrL/1BGVJ6plPh2XV9hLcruHRkjFO7AXATQprlS2lBxLqgnM5WIgdj25aU8UCesWpDei9kHOkRJtnIzUA9cko+BFcTsU7xIMlhTh5WjqQiw==',key_name='tempest-keypair-1558375347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a055627447c452fb366996320d60200',ramdisk_id='',reservation_id='r-9ed7vtiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-169717009',owner_user_name='tempest-SnapshotDataIntegrityTests-169717009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bf41fe4e06e4a0490cc6f9c20016d56',uuid=45154992-3213-43fa-89dc-d433f57ae978,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Converting VIF {"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:07:30,bridge_name='br-int',has_traffic_filtering=True,id=56dea8af-36d1-4ec2-be04-65a386672144,network=Network(e41d07f1-168e-4349-9ecb-e02dca523951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56dea8af-36') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG os_vif [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:07:30,bridge_name='br-int',has_traffic_filtering=True,id=56dea8af-36d1-4ec2-be04-65a386672144,network=Network(e41d07f1-168e-4349-9ecb-e02dca523951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56dea8af-36') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07534396-3876-56f2-a0c0-c227921a196c', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56dea8af-36, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56dea8af-36, col_values=(('qos', UUID('e98ac6d8-1a01-4e9c-b234-f2a0e86b2af9')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56dea8af-36, col_values=(('external_ids', {'iface-id': '56dea8af-36d1-4ec2-be04-65a386672144', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:07:30', 'vm-uuid': '45154992-3213-43fa-89dc-d433f57ae978'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:17 user nova-compute[75813]: INFO os_vif [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:07:30,bridge_name='br-int',has_traffic_filtering=True,id=56dea8af-36d1-4ec2-be04-65a386672144,network=Network(e41d07f1-168e-4349-9ecb-e02dca523951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56dea8af-36')
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No VIF found with MAC fa:16:3e:a5:07:30, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.network.neutron [req-5a369c08-bbcf-4e27-a135-3938cff1a63b req-e0e67524-fd70-46fc-8ae9-f3cc06cb95bc service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updated VIF entry in instance network info cache for port 56dea8af-36d1-4ec2-be04-65a386672144. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG nova.network.neutron [req-5a369c08-bbcf-4e27-a135-3938cff1a63b req-e0e67524-fd70-46fc-8ae9-f3cc06cb95bc service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updating instance_info_cache with network_info: [{"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:52:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5a369c08-bbcf-4e27-a135-3938cff1a63b req-e0e67524-fd70-46fc-8ae9-f3cc06cb95bc service nova] Releasing lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:52:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-e8bdb2ca-0eed-48e9-979b-61d858d8ed69 req-9aae4b99-b49a-421f-834d-47dca4e861a4 service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Received event network-vif-plugged-56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e8bdb2ca-0eed-48e9-979b-61d858d8ed69 req-9aae4b99-b49a-421f-834d-47dca4e861a4 service nova] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e8bdb2ca-0eed-48e9-979b-61d858d8ed69 req-9aae4b99-b49a-421f-834d-47dca4e861a4 service nova] Lock "45154992-3213-43fa-89dc-d433f57ae978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e8bdb2ca-0eed-48e9-979b-61d858d8ed69 req-9aae4b99-b49a-421f-834d-47dca4e861a4 service nova] Lock "45154992-3213-43fa-89dc-d433f57ae978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-e8bdb2ca-0eed-48e9-979b-61d858d8ed69 req-9aae4b99-b49a-421f-834d-47dca4e861a4 service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] No waiting events found dispatching network-vif-plugged-56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:19 user nova-compute[75813]: WARNING nova.compute.manager [req-e8bdb2ca-0eed-48e9-979b-61d858d8ed69 req-9aae4b99-b49a-421f-834d-47dca4e861a4 service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Received unexpected event network-vif-plugged-56dea8af-36d1-4ec2-be04-65a386672144 for instance with vm_state building and task_state spawning.
Nov 15 12:52:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:52:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Instance spawned successfully.
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:21 user nova-compute[75813]: INFO nova.compute.manager [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:52:21 user nova-compute[75813]: INFO nova.compute.manager [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Took 7.23 seconds to build instance.
Nov 15 12:52:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3afddc11-a710-4fd9-867a-0147477cdc5e tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.366s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-31586c63-525e-4727-ab06-81379b6a2b08 req-39a7a267-f572-455c-ac3a-da05a58e2fd6 service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Received event network-vif-plugged-56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-31586c63-525e-4727-ab06-81379b6a2b08 req-39a7a267-f572-455c-ac3a-da05a58e2fd6 service nova] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-31586c63-525e-4727-ab06-81379b6a2b08 req-39a7a267-f572-455c-ac3a-da05a58e2fd6 service nova] Lock "45154992-3213-43fa-89dc-d433f57ae978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-31586c63-525e-4727-ab06-81379b6a2b08 req-39a7a267-f572-455c-ac3a-da05a58e2fd6 service nova] Lock "45154992-3213-43fa-89dc-d433f57ae978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-31586c63-525e-4727-ab06-81379b6a2b08 req-39a7a267-f572-455c-ac3a-da05a58e2fd6 service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] No waiting events found dispatching network-vif-plugged-56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:21 user nova-compute[75813]: WARNING nova.compute.manager [req-31586c63-525e-4727-ab06-81379b6a2b08 req-39a7a267-f572-455c-ac3a-da05a58e2fd6 service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Received unexpected event network-vif-plugged-56dea8af-36d1-4ec2-be04-65a386672144 for instance with vm_state active and task_state None.
Nov 15 12:52:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:29 user nova-compute[75813]: INFO nova.compute.manager [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Detaching volume 2550b973-6759-4b8f-9f0f-cda4ac19d357
Nov 15 12:52:29 user nova-compute[75813]: INFO nova.virt.block_device [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Attempting to driver detach volume 2550b973-6759-4b8f-9f0f-cda4ac19d357 from mountpoint /dev/vdb
Nov 15 12:52:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Attempting to detach device vdb from instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:52:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:52:29 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:52:29 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 12:52:29 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:52:29 user nova-compute[75813]:   <serial>2550b973-6759-4b8f-9f0f-cda4ac19d357</serial>
Nov 15 12:52:29 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:52:29 user nova-compute[75813]: </disk>
Nov 15 12:52:29 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:52:29 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully detached device vdb from instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e from the persistent domain config.
Nov 15 12:52:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:52:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:52:29 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:52:29 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 12:52:29 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:52:29 user nova-compute[75813]:   <serial>2550b973-6759-4b8f-9f0f-cda4ac19d357</serial>
Nov 15 12:52:29 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:52:29 user nova-compute[75813]: </disk>
Nov 15 12:52:29 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:52:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:52:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:29 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:52:29 user nova-compute[75813]: INFO nova.compute.claims [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Claim successful on node user
Nov 15 12:52:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:52:30 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:52:30 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:52:30 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Creating image(s)
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG nova.policy [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74615b8601894772b20328f7b894c9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce97b303bdb940c59d6cea5ad91ef0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.239s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk 1073741824" returned: 0 in 0.050s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Cannot resize image /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Ensure instance console log exists: /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:31 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Successfully created port: 637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Successfully updated port: 637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquired lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-b91117e9-4907-4d31-bb46-d07f28ac0d7e req-fba16455-1970-4999-8a53-83b6175ab80b service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-changed-637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-b91117e9-4907-4d31-bb46-d07f28ac0d7e req-fba16455-1970-4999-8a53-83b6175ab80b service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Refreshing instance network info cache due to event network-changed-637149a0-24b9-4fed-8cc4-6dd3a909c874. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b91117e9-4907-4d31-bb46-d07f28ac0d7e req-fba16455-1970-4999-8a53-83b6175ab80b service nova] Acquiring lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updating instance_info_cache with network_info: [{"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Releasing lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Instance network_info: |[{"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b91117e9-4907-4d31-bb46-d07f28ac0d7e req-fba16455-1970-4999-8a53-83b6175ab80b service nova] Acquired lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.network.neutron [req-b91117e9-4907-4d31-bb46-d07f28ac0d7e req-fba16455-1970-4999-8a53-83b6175ab80b service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Refreshing network info cache for port 637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Start _get_guest_xml network_info=[{"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:52:32 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:52:32 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211354557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211354557',id=15,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy1dLT3BMBPj0HMd2wO6SlIfeOmZ5zLbEAioS6Myt1UETKqLiMh/MFli0JtJDPjUkaSiV8utv6xgh1ZfE1PdfxOgyxPJzAm7dYkPDYpHgRwmjqP16hyPEVizDOZD284gw==',key_name='tempest-keypair-1348731404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce97b303bdb940c59d6cea5ad91ef0d4',ramdisk_id='',reservation_id='r-mq0pxr7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1179121499',owner_user_name='tempest-TaggedAttachmentsTest-1179121499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74615b8601894772b20328f7b894c9a1',uuid=868f2db9-e52c-4f9a-8bd3-18ec6807377e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converting VIF {"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=637149a0-24b9-4fed-8cc4-6dd3a909c874,network=Network(939963f6-20b9-4559-b0db-8b37b974e899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637149a0-24') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lazy-loading 'pci_devices' on Instance uuid 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:52:32 user nova-compute[75813]:   <uuid>868f2db9-e52c-4f9a-8bd3-18ec6807377e</uuid>
Nov 15 12:52:32 user nova-compute[75813]:   <name>instance-0000000f</name>
Nov 15 12:52:32 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:52:32 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:52:32 user nova-compute[75813]:   <metadata>
Nov 15 12:52:32 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:52:32 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:52:32 user nova-compute[75813]:       <nova:name>tempest-device-tagging-server-211354557</nova:name>
Nov 15 12:52:32 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:52:32</nova:creationTime>
Nov 15 12:52:32 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:52:32 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:52:32 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:52:32 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:52:32 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:52:32 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:52:32 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:52:32 user nova-compute[75813]:       <nova:owner>
Nov 15 12:52:32 user nova-compute[75813]:         <nova:user uuid="74615b8601894772b20328f7b894c9a1">tempest-TaggedAttachmentsTest-1179121499-project-member</nova:user>
Nov 15 12:52:32 user nova-compute[75813]:         <nova:project uuid="ce97b303bdb940c59d6cea5ad91ef0d4">tempest-TaggedAttachmentsTest-1179121499</nova:project>
Nov 15 12:52:32 user nova-compute[75813]:       </nova:owner>
Nov 15 12:52:32 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:52:32 user nova-compute[75813]:       <nova:ports>
Nov 15 12:52:32 user nova-compute[75813]:         <nova:port uuid="637149a0-24b9-4fed-8cc4-6dd3a909c874">
Nov 15 12:52:32 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 12:52:32 user nova-compute[75813]:         </nova:port>
Nov 15 12:52:32 user nova-compute[75813]:       </nova:ports>
Nov 15 12:52:32 user nova-compute[75813]:     </nova:instance>
Nov 15 12:52:32 user nova-compute[75813]:   </metadata>
Nov 15 12:52:32 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:52:32 user nova-compute[75813]:     <system>
Nov 15 12:52:32 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:52:32 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:52:32 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:52:32 user nova-compute[75813]:       <entry name="serial">868f2db9-e52c-4f9a-8bd3-18ec6807377e</entry>
Nov 15 12:52:32 user nova-compute[75813]:       <entry name="uuid">868f2db9-e52c-4f9a-8bd3-18ec6807377e</entry>
Nov 15 12:52:32 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:52:32 user nova-compute[75813]:     </system>
Nov 15 12:52:32 user nova-compute[75813]:   </sysinfo>
Nov 15 12:52:32 user nova-compute[75813]:   <os>
Nov 15 12:52:32 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:52:32 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:52:32 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:52:32 user nova-compute[75813]:   </os>
Nov 15 12:52:32 user nova-compute[75813]:   <features>
Nov 15 12:52:32 user nova-compute[75813]:     <acpi/>
Nov 15 12:52:32 user nova-compute[75813]:     <apic/>
Nov 15 12:52:32 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:52:32 user nova-compute[75813]:   </features>
Nov 15 12:52:32 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:52:32 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:52:32 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:52:32 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:52:32 user nova-compute[75813]:   </clock>
Nov 15 12:52:32 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:52:32 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:52:32 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:52:32 user nova-compute[75813]:   </cpu>
Nov 15 12:52:32 user nova-compute[75813]:   <devices>
Nov 15 12:52:32 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:52:32 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:52:32 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk"/>
Nov 15 12:52:32 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:52:32 user nova-compute[75813]:     </disk>
Nov 15 12:52:32 user nova-compute[75813]:     <disk type="file" device="cdrom">
Nov 15 12:52:32 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 12:52:32 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk.config"/>
Nov 15 12:52:32 user nova-compute[75813]:       <target dev="hda" bus="ide"/>
Nov 15 12:52:32 user nova-compute[75813]:     </disk>
Nov 15 12:52:32 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:52:32 user nova-compute[75813]:       <mac address="fa:16:3e:e0:6d:60"/>
Nov 15 12:52:32 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:52:32 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:52:32 user nova-compute[75813]:       <target dev="tap637149a0-24"/>
Nov 15 12:52:32 user nova-compute[75813]:     </interface>
Nov 15 12:52:32 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:52:32 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/console.log" append="off"/>
Nov 15 12:52:32 user nova-compute[75813]:     </serial>
Nov 15 12:52:32 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:52:32 user nova-compute[75813]:     <video>
Nov 15 12:52:32 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:52:32 user nova-compute[75813]:     </video>
Nov 15 12:52:32 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:52:32 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:52:32 user nova-compute[75813]:     </rng>
Nov 15 12:52:32 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:52:32 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:52:32 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:52:32 user nova-compute[75813]:     </memballoon>
Nov 15 12:52:32 user nova-compute[75813]:   </devices>
Nov 15 12:52:32 user nova-compute[75813]: </domain>
Nov 15 12:52:32 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211354557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211354557',id=15,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy1dLT3BMBPj0HMd2wO6SlIfeOmZ5zLbEAioS6Myt1UETKqLiMh/MFli0JtJDPjUkaSiV8utv6xgh1ZfE1PdfxOgyxPJzAm7dYkPDYpHgRwmjqP16hyPEVizDOZD284gw==',key_name='tempest-keypair-1348731404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce97b303bdb940c59d6cea5ad91ef0d4',ramdisk_id='',reservation_id='r-mq0pxr7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1179121499',owner_user_name='tempest-TaggedAttachmentsTest-1179121499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74615b8601894772b20328f7b894c9a1',uuid=868f2db9-e52c-4f9a-8bd3-18ec6807377e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converting VIF {"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=637149a0-24b9-4fed-8cc4-6dd3a909c874,network=Network(939963f6-20b9-4559-b0db-8b37b974e899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637149a0-24') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG os_vif [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=637149a0-24b9-4fed-8cc4-6dd3a909c874,network=Network(939963f6-20b9-4559-b0db-8b37b974e899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637149a0-24') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20488223-16b9-5696-8f75-f22b48606555', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap637149a0-24, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap637149a0-24, col_values=(('qos', UUID('8e11c97b-cbd5-4bb2-8ca1-cab1ac45bc9b')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap637149a0-24, col_values=(('external_ids', {'iface-id': '637149a0-24b9-4fed-8cc4-6dd3a909c874', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:6d:60', 'vm-uuid': '868f2db9-e52c-4f9a-8bd3-18ec6807377e'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:32 user nova-compute[75813]: INFO os_vif [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=637149a0-24b9-4fed-8cc4-6dd3a909c874,network=Network(939963f6-20b9-4559-b0db-8b37b974e899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637149a0-24')
Nov 15 12:52:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:52:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] No BDM found with device name hda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:52:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] No VIF found with MAC fa:16:3e:e0:6d:60, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:52:33 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Using config drive
Nov 15 12:52:33 user nova-compute[75813]: DEBUG nova.network.neutron [req-b91117e9-4907-4d31-bb46-d07f28ac0d7e req-fba16455-1970-4999-8a53-83b6175ab80b service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updated VIF entry in instance network info cache for port 637149a0-24b9-4fed-8cc4-6dd3a909c874. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:52:33 user nova-compute[75813]: DEBUG nova.network.neutron [req-b91117e9-4907-4d31-bb46-d07f28ac0d7e req-fba16455-1970-4999-8a53-83b6175ab80b service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updating instance_info_cache with network_info: [{"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:52:33 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Creating config drive at /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk.config
Nov 15 12:52:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp67nhzpmk {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b91117e9-4907-4d31-bb46-d07f28ac0d7e req-fba16455-1970-4999-8a53-83b6175ab80b service nova] Releasing lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:52:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp67nhzpmk" returned: 0 in 0.063s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG nova.compute.manager [req-5ea03ea5-58ee-455f-8e9c-abe62f76e46e req-85ff8832-a260-41d9-84fd-aeaf2d1cffc6 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-vif-plugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5ea03ea5-58ee-455f-8e9c-abe62f76e46e req-85ff8832-a260-41d9-84fd-aeaf2d1cffc6 service nova] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5ea03ea5-58ee-455f-8e9c-abe62f76e46e req-85ff8832-a260-41d9-84fd-aeaf2d1cffc6 service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5ea03ea5-58ee-455f-8e9c-abe62f76e46e req-85ff8832-a260-41d9-84fd-aeaf2d1cffc6 service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG nova.compute.manager [req-5ea03ea5-58ee-455f-8e9c-abe62f76e46e req-85ff8832-a260-41d9-84fd-aeaf2d1cffc6 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] No waiting events found dispatching network-vif-plugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:36 user nova-compute[75813]: WARNING nova.compute.manager [req-5ea03ea5-58ee-455f-8e9c-abe62f76e46e req-85ff8832-a260-41d9-84fd-aeaf2d1cffc6 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received unexpected event network-vif-plugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 for instance with vm_state building and task_state spawning.
Nov 15 12:52:36 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:52:36 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Instance spawned successfully.
Nov 15 12:52:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:37 user nova-compute[75813]: INFO nova.compute.manager [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 15 12:52:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:52:37 user nova-compute[75813]: INFO nova.compute.manager [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Took 7.24 seconds to build instance.
Nov 15 12:52:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a04dfd99-5695-4cbb-809a-09451e1171a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.363s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:38 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:52:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:52:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-76c16d97-3ad7-484a-96f6-b8b08e98c340 req-dacb7fca-1170-4e8e-b8cc-4db10c872612 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-vif-plugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-76c16d97-3ad7-484a-96f6-b8b08e98c340 req-dacb7fca-1170-4e8e-b8cc-4db10c872612 service nova] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-76c16d97-3ad7-484a-96f6-b8b08e98c340 req-dacb7fca-1170-4e8e-b8cc-4db10c872612 service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-76c16d97-3ad7-484a-96f6-b8b08e98c340 req-dacb7fca-1170-4e8e-b8cc-4db10c872612 service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-76c16d97-3ad7-484a-96f6-b8b08e98c340 req-dacb7fca-1170-4e8e-b8cc-4db10c872612 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] No waiting events found dispatching network-vif-plugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:38 user nova-compute[75813]: WARNING nova.compute.manager [req-76c16d97-3ad7-484a-96f6-b8b08e98c340 req-dacb7fca-1170-4e8e-b8cc-4db10c872612 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received unexpected event network-vif-plugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 for instance with vm_state active and task_state None.
Nov 15 12:52:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:52:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:52:40 user nova-compute[75813]: INFO nova.compute.claims [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Claim successful on node user
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:52:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:52:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Creating image(s)
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "/opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "/opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG nova.policy [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fa6040843394b2fa38e29ff70e9d3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221ec165127e467a9131e2ff691429b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.186s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk 1073741824" returned: 0 in 0.051s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Successfully created port: 6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Cannot resize image /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Ensure instance console log exists: /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Successfully updated port: 6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquired lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-1b624607-f89e-4625-bc31-48db93d678d9 req-81ede98a-0073-4cc0-bb9c-8d2d6de7224b service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Received event network-changed-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-1b624607-f89e-4625-bc31-48db93d678d9 req-81ede98a-0073-4cc0-bb9c-8d2d6de7224b service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Refreshing instance network info cache due to event network-changed-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1b624607-f89e-4625-bc31-48db93d678d9 req-81ede98a-0073-4cc0-bb9c-8d2d6de7224b service nova] Acquiring lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Updating instance_info_cache with network_info: [{"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Releasing lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Instance network_info: |[{"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1b624607-f89e-4625-bc31-48db93d678d9 req-81ede98a-0073-4cc0-bb9c-8d2d6de7224b service nova] Acquired lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.network.neutron [req-1b624607-f89e-4625-bc31-48db93d678d9 req-81ede98a-0073-4cc0-bb9c-8d2d6de7224b service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Refreshing network info cache for port 6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Start _get_guest_xml network_info=[{"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:52:42 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:52:42 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-519097021',display_name='tempest-VolumesAdminNegativeTest-server-519097021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-519097021',id=16,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4vHohf8iUtJwYF7jFsu982PRIqgU03JJiPRbyn6FK6+1gwivkR0eL1NHE7Y+DsQAwvVMm8dpEeBEJ9XTww235hwvH5AkWLLGMud5OnQjVvKAQ0eV9vZ2eko52NGo8roA==',key_name='tempest-keypair-1492071841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='221ec165127e467a9131e2ff691429b1',ramdisk_id='',reservation_id='r-j4t3y6p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1498772195',owner_user_name='tempest-VolumesAdminNegativeTest-1498772195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fa6040843394b2fa38e29ff70e9d3ed',uuid=2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converting VIF {"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:9b:92,bridge_name='br-int',has_traffic_filtering=True,id=6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1dbfc6-c7') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.objects.instance [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:52:42 user nova-compute[75813]:   <uuid>2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa</uuid>
Nov 15 12:52:42 user nova-compute[75813]:   <name>instance-00000010</name>
Nov 15 12:52:42 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:52:42 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:52:42 user nova-compute[75813]:   <metadata>
Nov 15 12:52:42 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:52:42 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:52:42 user nova-compute[75813]:       <nova:name>tempest-VolumesAdminNegativeTest-server-519097021</nova:name>
Nov 15 12:52:42 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:52:42</nova:creationTime>
Nov 15 12:52:42 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:52:42 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:52:42 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:52:42 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:52:42 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:52:42 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:52:42 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:52:42 user nova-compute[75813]:       <nova:owner>
Nov 15 12:52:42 user nova-compute[75813]:         <nova:user uuid="9fa6040843394b2fa38e29ff70e9d3ed">tempest-VolumesAdminNegativeTest-1498772195-project-member</nova:user>
Nov 15 12:52:42 user nova-compute[75813]:         <nova:project uuid="221ec165127e467a9131e2ff691429b1">tempest-VolumesAdminNegativeTest-1498772195</nova:project>
Nov 15 12:52:42 user nova-compute[75813]:       </nova:owner>
Nov 15 12:52:42 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:52:42 user nova-compute[75813]:       <nova:ports>
Nov 15 12:52:42 user nova-compute[75813]:         <nova:port uuid="6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69">
Nov 15 12:52:42 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 12:52:42 user nova-compute[75813]:         </nova:port>
Nov 15 12:52:42 user nova-compute[75813]:       </nova:ports>
Nov 15 12:52:42 user nova-compute[75813]:     </nova:instance>
Nov 15 12:52:42 user nova-compute[75813]:   </metadata>
Nov 15 12:52:42 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:52:42 user nova-compute[75813]:     <system>
Nov 15 12:52:42 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:52:42 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:52:42 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:52:42 user nova-compute[75813]:       <entry name="serial">2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa</entry>
Nov 15 12:52:42 user nova-compute[75813]:       <entry name="uuid">2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa</entry>
Nov 15 12:52:42 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:52:42 user nova-compute[75813]:     </system>
Nov 15 12:52:42 user nova-compute[75813]:   </sysinfo>
Nov 15 12:52:42 user nova-compute[75813]:   <os>
Nov 15 12:52:42 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:52:42 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:52:42 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:52:42 user nova-compute[75813]:   </os>
Nov 15 12:52:42 user nova-compute[75813]:   <features>
Nov 15 12:52:42 user nova-compute[75813]:     <acpi/>
Nov 15 12:52:42 user nova-compute[75813]:     <apic/>
Nov 15 12:52:42 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:52:42 user nova-compute[75813]:   </features>
Nov 15 12:52:42 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:52:42 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:52:42 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:52:42 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:52:42 user nova-compute[75813]:   </clock>
Nov 15 12:52:42 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:52:42 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:52:42 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:52:42 user nova-compute[75813]:   </cpu>
Nov 15 12:52:42 user nova-compute[75813]:   <devices>
Nov 15 12:52:42 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:52:42 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:52:42 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk"/>
Nov 15 12:52:42 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:52:42 user nova-compute[75813]:     </disk>
Nov 15 12:52:42 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:52:42 user nova-compute[75813]:       <mac address="fa:16:3e:bc:9b:92"/>
Nov 15 12:52:42 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:52:42 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:52:42 user nova-compute[75813]:       <target dev="tap6f1dbfc6-c7"/>
Nov 15 12:52:42 user nova-compute[75813]:     </interface>
Nov 15 12:52:42 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:52:42 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/console.log" append="off"/>
Nov 15 12:52:42 user nova-compute[75813]:     </serial>
Nov 15 12:52:42 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:52:42 user nova-compute[75813]:     <video>
Nov 15 12:52:42 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:52:42 user nova-compute[75813]:     </video>
Nov 15 12:52:42 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:52:42 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:52:42 user nova-compute[75813]:     </rng>
Nov 15 12:52:42 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:52:42 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:52:42 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:52:42 user nova-compute[75813]:     </memballoon>
Nov 15 12:52:42 user nova-compute[75813]:   </devices>
Nov 15 12:52:42 user nova-compute[75813]: </domain>
Nov 15 12:52:42 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-519097021',display_name='tempest-VolumesAdminNegativeTest-server-519097021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-519097021',id=16,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4vHohf8iUtJwYF7jFsu982PRIqgU03JJiPRbyn6FK6+1gwivkR0eL1NHE7Y+DsQAwvVMm8dpEeBEJ9XTww235hwvH5AkWLLGMud5OnQjVvKAQ0eV9vZ2eko52NGo8roA==',key_name='tempest-keypair-1492071841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='221ec165127e467a9131e2ff691429b1',ramdisk_id='',reservation_id='r-j4t3y6p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1498772195',owner_user_name='tempest-VolumesAdminNegativeTest-1498772195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fa6040843394b2fa38e29ff70e9d3ed',uuid=2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converting VIF {"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:9b:92,bridge_name='br-int',has_traffic_filtering=True,id=6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1dbfc6-c7') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG os_vif [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:9b:92,bridge_name='br-int',has_traffic_filtering=True,id=6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1dbfc6-c7') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d4a61d7-686e-57c6-9f68-a418eda0b136', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f1dbfc6-c7, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f1dbfc6-c7, col_values=(('qos', UUID('17259576-f54d-4bee-8b5f-5f6e5f4bfbdd')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f1dbfc6-c7, col_values=(('external_ids', {'iface-id': '6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:9b:92', 'vm-uuid': '2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:42 user nova-compute[75813]: INFO os_vif [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:9b:92,bridge_name='br-int',has_traffic_filtering=True,id=6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1dbfc6-c7')
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:52:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] No VIF found with MAC fa:16:3e:bc:9b:92, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:52:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-1b624607-f89e-4625-bc31-48db93d678d9 req-81ede98a-0073-4cc0-bb9c-8d2d6de7224b service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Updated VIF entry in instance network info cache for port 6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:52:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-1b624607-f89e-4625-bc31-48db93d678d9 req-81ede98a-0073-4cc0-bb9c-8d2d6de7224b service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Updating instance_info_cache with network_info: [{"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:52:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1b624607-f89e-4625-bc31-48db93d678d9 req-81ede98a-0073-4cc0-bb9c-8d2d6de7224b service nova] Releasing lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:52:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:43 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:52:43 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:52:43 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7942MB free_disk=25.45315170288086GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:52:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Applying migration context for instance 36b32262-4ea0-4a33-9672-82c7b8061bb1 as it has an incoming, in-progress migration d4a2e336-0ebe-44c9-91be-a231e9d41f82. Migration status is finished {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 12:52:44 user nova-compute[75813]: INFO nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating resource usage from migration d4a2e336-0ebe-44c9-91be-a231e9d41f82
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 870cf760-ae0c-4df1-99cf-6403d8e642ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Migration d4a2e336-0ebe-44c9-91be-a231e9d41f82 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 36b32262-4ea0-4a33-9672-82c7b8061bb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance c15606eb-006c-4a2d-9f2b-a4cc69cc6f19 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 45154992-3213-43fa-89dc-d433f57ae978 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-6d7dd813-ff97-4d2e-89b0-62d0eb456a07 req-23234da7-b251-46f4-a4fd-1692f86a78d6 service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Received event network-vif-plugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6d7dd813-ff97-4d2e-89b0-62d0eb456a07 req-23234da7-b251-46f4-a4fd-1692f86a78d6 service nova] Acquiring lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6d7dd813-ff97-4d2e-89b0-62d0eb456a07 req-23234da7-b251-46f4-a4fd-1692f86a78d6 service nova] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6d7dd813-ff97-4d2e-89b0-62d0eb456a07 req-23234da7-b251-46f4-a4fd-1692f86a78d6 service nova] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-6d7dd813-ff97-4d2e-89b0-62d0eb456a07 req-23234da7-b251-46f4-a4fd-1692f86a78d6 service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] No waiting events found dispatching network-vif-plugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:44 user nova-compute[75813]: WARNING nova.compute.manager [req-6d7dd813-ff97-4d2e-89b0-62d0eb456a07 req-23234da7-b251-46f4-a4fd-1692f86a78d6 service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Received unexpected event network-vif-plugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 for instance with vm_state building and task_state spawning.
Nov 15 12:52:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:52:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:52:46 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Instance spawned successfully.
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:52:46 user nova-compute[75813]: INFO nova.compute.manager [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:52:46 user nova-compute[75813]: INFO nova.compute.manager [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Took 6.43 seconds to build instance.
Nov 15 12:52:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e78c9cf-8a05-4992-a08f-4d1b1581b050 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.527s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-0e079b87-c769-4fb4-9543-0f72715d2f9b req-3a324a4c-d7e5-4e3f-b482-ae7fbd1bcf81 service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Received event network-vif-plugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0e079b87-c769-4fb4-9543-0f72715d2f9b req-3a324a4c-d7e5-4e3f-b482-ae7fbd1bcf81 service nova] Acquiring lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0e079b87-c769-4fb4-9543-0f72715d2f9b req-3a324a4c-d7e5-4e3f-b482-ae7fbd1bcf81 service nova] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0e079b87-c769-4fb4-9543-0f72715d2f9b req-3a324a4c-d7e5-4e3f-b482-ae7fbd1bcf81 service nova] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-0e079b87-c769-4fb4-9543-0f72715d2f9b req-3a324a4c-d7e5-4e3f-b482-ae7fbd1bcf81 service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] No waiting events found dispatching network-vif-plugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:46 user nova-compute[75813]: WARNING nova.compute.manager [req-0e079b87-c769-4fb4-9543-0f72715d2f9b req-3a324a4c-d7e5-4e3f-b482-ae7fbd1bcf81 service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Received unexpected event network-vif-plugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 for instance with vm_state active and task_state None.
Nov 15 12:52:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:49 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e is timed out.
Nov 15 12:52:49 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully detached device vdb from instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e from the live domain config.
Nov 15 12:52:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRDjiVya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:52:49 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:52:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5788b4-ee03-4c0a-942d-aa569a15a679]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:52:49 user nova-compute[75813]: No targets found.
Nov 15 12:52:49 user nova-compute[75813]: iSNS:
Nov 15 12:52:49 user nova-compute[75813]: No targets found.
Nov 15 12:52:49 user nova-compute[75813]: STATIC:
Nov 15 12:52:49 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69
Nov 15 12:52:49 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:49 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:49 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357
Nov 15 12:52:49 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:49 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:49 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62
Nov 15 12:52:49 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:49 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:49 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6
Nov 15 12:52:49 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:49 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:49 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:52:49 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:49 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:49 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483
Nov 15 12:52:49 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:49 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:49 user nova-compute[75813]: FIRMWARE:
Nov 15 12:52:49 user nova-compute[75813]: No targets found.
Nov 15 12:52:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:52:49 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:52:49 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[521913ec-baeb-4ad7-8563-dc6505e864cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5826228a-1597-475e-9e02-86cdb027cccf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:52:50 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:52:50 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:52:50 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:52:50 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:52:50 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:52:50 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:52:50 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:52:50 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:52:50 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:52:50 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:52:50 user nova-compute[75813]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 (non-flash)
Nov 15 12:52:50 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550473c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af43b03-8fa4-452f-93f2-b762fb3c489b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f607835d-b73c-467b-843d-cc396c90478e]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8446a8-3566-4463-9883-d5847a61d48f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7960517f-5f0c-401a-b920-d1a57eebf8ea]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0bfad9-8cd0-416d-ba1d-0d20e5bcfdb7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b42762-f683-48ce-ab70-82d411362ab8]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357, portal: 172.16.0.220,3260]
Nov 15 12:52:50 user nova-compute[75813]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357, portal: 172.16.0.220,3260] successful.
Nov 15 12:52:50 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2550b973-6759-4b8f-9f0f-cda4ac19d357 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[89642798-d36d-4159-9275-d4bdbce5524d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] <== disconnect_volume: return (352ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:52:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:51 user nova-compute[75813]: DEBUG nova.objects.instance [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'flavor' on Instance uuid 48d7cb39-a436-4b01-87cc-77e917ac5c0e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:52:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea13e216-ba3b-43b3-817e-e40cbfd4dacf tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.942s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:53 user nova-compute[75813]: DEBUG nova.compute.manager [req-f913e55b-0374-430a-8d63-1c34e7d26f54 req-03ffe52d-54d3-4af4-acdc-7e0beb6db2b3 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-changed-0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:53 user nova-compute[75813]: DEBUG nova.compute.manager [req-f913e55b-0374-430a-8d63-1c34e7d26f54 req-03ffe52d-54d3-4af4-acdc-7e0beb6db2b3 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing instance network info cache due to event network-changed-0635a5ae-c421-491c-9fce-56ac8b2ecec6. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:52:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f913e55b-0374-430a-8d63-1c34e7d26f54 req-03ffe52d-54d3-4af4-acdc-7e0beb6db2b3 service nova] Acquiring lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:52:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f913e55b-0374-430a-8d63-1c34e7d26f54 req-03ffe52d-54d3-4af4-acdc-7e0beb6db2b3 service nova] Acquired lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:52:53 user nova-compute[75813]: DEBUG nova.network.neutron [req-f913e55b-0374-430a-8d63-1c34e7d26f54 req-03ffe52d-54d3-4af4-acdc-7e0beb6db2b3 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Refreshing network info cache for port 0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:52:53 user nova-compute[75813]: DEBUG nova.network.neutron [req-f913e55b-0374-430a-8d63-1c34e7d26f54 req-03ffe52d-54d3-4af4-acdc-7e0beb6db2b3 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updated VIF entry in instance network info cache for port 0635a5ae-c421-491c-9fce-56ac8b2ecec6. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:52:53 user nova-compute[75813]: DEBUG nova.network.neutron [req-f913e55b-0374-430a-8d63-1c34e7d26f54 req-03ffe52d-54d3-4af4-acdc-7e0beb6db2b3 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating instance_info_cache with network_info: [{"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:52:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f913e55b-0374-430a-8d63-1c34e7d26f54 req-03ffe52d-54d3-4af4-acdc-7e0beb6db2b3 service nova] Releasing lock "refresh_cache-fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:52:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:55 user nova-compute[75813]: INFO nova.compute.manager [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Terminating instance
Nov 15 12:52:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:52:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-d6adb224-a849-4097-bf82-419d190540c9 req-0efb6cd9-95b6-4c40-84d9-fffaef1eef4b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d6adb224-a849-4097-bf82-419d190540c9 req-0efb6cd9-95b6-4c40-84d9-fffaef1eef4b service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d6adb224-a849-4097-bf82-419d190540c9 req-0efb6cd9-95b6-4c40-84d9-fffaef1eef4b service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d6adb224-a849-4097-bf82-419d190540c9 req-0efb6cd9-95b6-4c40-84d9-fffaef1eef4b service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-d6adb224-a849-4097-bf82-419d190540c9 req-0efb6cd9-95b6-4c40-84d9-fffaef1eef4b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-unplugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-d6adb224-a849-4097-bf82-419d190540c9 req-0efb6cd9-95b6-4c40-84d9-fffaef1eef4b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-5f7f3ca3-5a40-4e49-8f0e-fc14c1b87079 req-ad29615a-45f9-4682-b882-f319e92ab2b1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-1933fd46-434b-469e-8fb0-3b18e23266e9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5f7f3ca3-5a40-4e49-8f0e-fc14c1b87079 req-ad29615a-45f9-4682-b882-f319e92ab2b1 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5f7f3ca3-5a40-4e49-8f0e-fc14c1b87079 req-ad29615a-45f9-4682-b882-f319e92ab2b1 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5f7f3ca3-5a40-4e49-8f0e-fc14c1b87079 req-ad29615a-45f9-4682-b882-f319e92ab2b1 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-5f7f3ca3-5a40-4e49-8f0e-fc14c1b87079 req-ad29615a-45f9-4682-b882-f319e92ab2b1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-unplugged-1933fd46-434b-469e-8fb0-3b18e23266e9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-5f7f3ca3-5a40-4e49-8f0e-fc14c1b87079 req-ad29615a-45f9-4682-b882-f319e92ab2b1 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-1933fd46-434b-469e-8fb0-3b18e23266e9 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-b3559073-98c9-40e9-8333-4f7caa9cffe7 req-a6add5ae-5af8-4472-b60c-468502ea6458 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b3559073-98c9-40e9-8333-4f7caa9cffe7 req-a6add5ae-5af8-4472-b60c-468502ea6458 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b3559073-98c9-40e9-8333-4f7caa9cffe7 req-a6add5ae-5af8-4472-b60c-468502ea6458 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b3559073-98c9-40e9-8333-4f7caa9cffe7 req-a6add5ae-5af8-4472-b60c-468502ea6458 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-b3559073-98c9-40e9-8333-4f7caa9cffe7 req-a6add5ae-5af8-4472-b60c-468502ea6458 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-unplugged-540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-b3559073-98c9-40e9-8333-4f7caa9cffe7 req-a6add5ae-5af8-4472-b60c-468502ea6458 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-540e4d59-b5b8-4fda-b957-00b5df385b15 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Instance destroyed successfully.
Nov 15 12:52:57 user nova-compute[75813]: DEBUG nova.objects.instance [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lazy-loading 'resources' on Instance uuid fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:62:46,bridge_name='br-int',has_traffic_filtering=True,id=0635a5ae-c421-491c-9fce-56ac8b2ecec6,network=Network(bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0635a5ae-c4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:62:46,bridge_name='br-int',has_traffic_filtering=True,id=0635a5ae-c421-491c-9fce-56ac8b2ecec6,network=Network(bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0635a5ae-c4') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0635a5ae-c4, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1991ec5-14ed-42b3-ae1c-86861097d9ca) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: INFO os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:62:46,bridge_name='br-int',has_traffic_filtering=True,id=0635a5ae-c421-491c-9fce-56ac8b2ecec6,network=Network(bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0635a5ae-c4')
Nov 15 12:52:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bd:4f,bridge_name='br-int',has_traffic_filtering=True,id=1933fd46-434b-469e-8fb0-3b18e23266e9,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1933fd46-43') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bd:4f,bridge_name='br-int',has_traffic_filtering=True,id=1933fd46-434b-469e-8fb0-3b18e23266e9,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1933fd46-43') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1933fd46-43, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ff4695e-fde5-461f-bd56-19dda3333864) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: INFO os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bd:4f,bridge_name='br-int',has_traffic_filtering=True,id=1933fd46-434b-469e-8fb0-3b18e23266e9,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1933fd46-43')
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:83:d9,bridge_name='br-int',has_traffic_filtering=True,id=d1a3f3dd-6674-41ba-bd0d-113faff3dc27,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1a3f3dd-66') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:83:d9,bridge_name='br-int',has_traffic_filtering=True,id=d1a3f3dd-6674-41ba-bd0d-113faff3dc27,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1a3f3dd-66') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1a3f3dd-66, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9553b2da-be5d-48e2-9b5a-637aaebc529b) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: INFO os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:83:d9,bridge_name='br-int',has_traffic_filtering=True,id=d1a3f3dd-6674-41ba-bd0d-113faff3dc27,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1a3f3dd-66')
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "540e4d59-b5b8-4fda-b957-00b5df385b15", "address": "fa:16:3e:d2:5f:0f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e4d59-b5", "ovs_interfaceid": "540e4d59-b5b8-4fda-b957-00b5df385b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:5f:0f,bridge_name='br-int',has_traffic_filtering=True,id=540e4d59-b5b8-4fda-b957-00b5df385b15,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e4d59-b5') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:5f:0f,bridge_name='br-int',has_traffic_filtering=True,id=540e4d59-b5b8-4fda-b957-00b5df385b15,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e4d59-b5') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap540e4d59-b5, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d06fb3b0-a3a1-49e3-85ad-5ab1b0a86a17) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: INFO os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:5f:0f,bridge_name='br-int',has_traffic_filtering=True,id=540e4d59-b5b8-4fda-b957-00b5df385b15,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e4d59-b5')
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b7:e0,bridge_name='br-int',has_traffic_filtering=True,id=89d2843f-9a4c-474f-8fd2-cb4d9d48f243,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d2843f-9a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b7:e0,bridge_name='br-int',has_traffic_filtering=True,id=89d2843f-9a4c-474f-8fd2-cb4d9d48f243,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d2843f-9a') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89d2843f-9a, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53731c45-0e21-4da1-a0db-0201aac37e32) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: INFO os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b7:e0,bridge_name='br-int',has_traffic_filtering=True,id=89d2843f-9a4c-474f-8fd2-cb4d9d48f243,network=Network(ee316a61-161f-434c-8d6a-b22bb5d87e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d2843f-9a')
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ccbc89d-26') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ccbc89d-26') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ccbc89d-26, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15610228-c492-4a3c-9da7-eeb38fed19ed) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:58 user nova-compute[75813]: WARNING nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-0635a5ae-c421-491c-9fce-56ac8b2ecec6 for instance with vm_state active and task_state deleting.
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-unplugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:58 user nova-compute[75813]: WARNING nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-d1a3f3dd-6674-41ba-bd0d-113faff3dc27 for instance with vm_state active and task_state deleting.
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-unplugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:58 user nova-compute[75813]: WARNING nova.compute.manager [req-0bf29559-77df-43a8-ae50-9928f383edac req-2dcfb286-9481-4a3a-bf1a-790615667486 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 for instance with vm_state active and task_state deleting.
Nov 15 12:52:58 user nova-compute[75813]: INFO os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ccbc89d-26')
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328978709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328978709',id=12,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmVQcUGHCyj7t7eK7O6jU7RmRhEIYQD6OZItd69s6ItE8RJumBIuntKH4284iHQqYL47mnU32XPRfufrHfMne7QknODVsbeYb8z5Ey1ZHnpBvtMQsyPsaiOLfmakxGObw==',key_name='tempest-keypair-784731642',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75d040d5bf67413aaa7185550a136c5d',ramdisk_id='',reservation_id='r-lo70gc5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-697679330',owner_user_name='tempest-TaggedBootDevicesTest-697679330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb44a530af7148bf870621622b5eec54',uuid=fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converting VIF {"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:59:59,bridge_name='br-int',has_traffic_filtering=True,id=c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5af2fa9-ac') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:59:59,bridge_name='br-int',has_traffic_filtering=True,id=c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5af2fa9-ac') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5af2fa9-ac, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd513716-a023-48e5-8374-894c3b66a9de) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:52:58 user nova-compute[75813]: INFO os_vif [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:59:59,bridge_name='br-int',has_traffic_filtering=True,id=c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2,network=Network(98186a4f-3eab-460d-8477-fe1edd4f5a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5af2fa9-ac')
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPvNJrzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:52:58 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb7e2be-6f56-4048-874b-c9780de5a57f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:52:58 user nova-compute[75813]: No targets found.
Nov 15 12:52:58 user nova-compute[75813]: iSNS:
Nov 15 12:52:58 user nova-compute[75813]: No targets found.
Nov 15 12:52:58 user nova-compute[75813]: STATIC:
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: FIRMWARE:
Nov 15 12:52:58 user nova-compute[75813]: No targets found.
Nov 15 12:52:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:52:58 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:52:58 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[661be5a7-db2d-498f-96e4-0c528e7aeb3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ae2dc0-a2a0-450f-af87-32a5e3d25c01]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550472e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69'): ({'sdc'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Removing single pathed devices sdc {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[126aa894-e6ba-46bb-ada5-cca0b7aed05c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b1e573-2c20-41c0-8a4e-a61e8611f952]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Flushing IO for device /dev/sdc {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe3080f-9be7-4b2e-9faf-6381c234f32a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cc14f5-5bee-4614-a32a-4446e6390dc5]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca63b291-52ac-419d-88c1-f77cb7aa3b01]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a38785-5545-4c95-8ab4-88d010f1a516]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69, portal: 172.16.0.220,3260]
Nov 15 12:52:58 user nova-compute[75813]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69, portal: 172.16.0.220,3260] successful.
Nov 15 12:52:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-1933fd46-434b-469e-8fb0-3b18e23266e9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-1933fd46-434b-469e-8fb0-3b18e23266e9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:58 user nova-compute[75813]: WARNING nova.compute.manager [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-1933fd46-434b-469e-8fb0-3b18e23266e9 for instance with vm_state active and task_state deleting.
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-unplugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:58 user nova-compute[75813]: WARNING nova.compute.manager [req-727cf6d2-e9a5-41f0-9c76-86822ba12502 req-c8f5746e-ad4b-4076-939a-3dc6386ebd2b service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c for instance with vm_state active and task_state deleting.
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92952268-506b-43e2-866e-a1fff3002f69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9921dd-b6a8-4223-9d4c-0be4c1308397]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] <== disconnect_volume: return (323ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVZLTOqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:52:58 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[71420c74-0422-4490-94cf-c593c09db26c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:52:58 user nova-compute[75813]: No targets found.
Nov 15 12:52:58 user nova-compute[75813]: iSNS:
Nov 15 12:52:58 user nova-compute[75813]: No targets found.
Nov 15 12:52:58 user nova-compute[75813]: STATIC:
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: FIRMWARE:
Nov 15 12:52:58 user nova-compute[75813]: No targets found.
Nov 15 12:52:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:52:58 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:52:58 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4083fda4-6a33-408b-a939-df824800aef1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f047c5-bc70-432f-8ab5-9f9376fff2d1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55506c1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483'): ({'sdd'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Removing single pathed devices sdd {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:58 user nova-compute[75813]: WARNING nova.compute.manager [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-540e4d59-b5b8-4fda-b957-00b5df385b15 for instance with vm_state active and task_state deleting.
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-unplugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-unplugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-plugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] Acquiring lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] No waiting events found dispatching network-vif-plugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:52:58 user nova-compute[75813]: WARNING nova.compute.manager [req-451c327f-d109-471f-ba55-139af7cdadd7 req-e0365b49-e3ce-406b-8240-af3e53e0992d service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received unexpected event network-vif-plugged-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 for instance with vm_state active and task_state deleting.
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4efc74b-f66d-4b59-9ff5-98cb78c188a5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9734db2f-44c2-470d-b1cf-86c1d3088673]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Flushing IO for device /dev/sdd {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.011s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[72531db3-b64e-460f-b3b1-ef599ede6783]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a240607-f5ec-411c-ad99-b2fe310916ab]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8092ef2-1b06-41e0-a4b2-f21381ac2f70]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e44d8d9-8723-4402-8aae-be46ec3dff67]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483, portal: 172.16.0.220,3260]
Nov 15 12:52:58 user nova-compute[75813]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483, portal: 172.16.0.220,3260] successful.
Nov 15 12:52:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2168e2-b8ef-47b9-9be2-ab6277c92483 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b354e396-01e3-4965-a8bb-b8f4cb7e735f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] <== disconnect_volume: return (297ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyKtJYdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:52:58 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[474e4652-01d7-441b-999c-a3258eaf8e9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:52:58 user nova-compute[75813]: No targets found.
Nov 15 12:52:58 user nova-compute[75813]: iSNS:
Nov 15 12:52:58 user nova-compute[75813]: No targets found.
Nov 15 12:52:58 user nova-compute[75813]: STATIC:
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:52:58 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:52:58 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:52:58 user nova-compute[75813]: FIRMWARE:
Nov 15 12:52:58 user nova-compute[75813]: No targets found.
Nov 15 12:52:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:52:58 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:52:58 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eecc00-c227-48b8-8c05-79b753499972]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d79092e-6c8e-4d9f-b5c9-b0a2b30dbd16]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:52:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:52:58 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:52:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55506c1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6'): ({'sde'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Removing single pathed devices sde {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7f843d-665c-4a27-b8df-4e4699282639]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c8db9f-8a9d-44be-a48b-23252b499fad]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Flushing IO for device /dev/sde {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.011s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea01ddc-c8c1-4f34-93bb-3836ac61f6e4]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[da709cf0-ef25-4279-a451-746daa156073]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf305a73-ab35-4dd8-a423-e02f1534c849]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac1e98c-d9ab-43fe-9dc3-afc4c3119655]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6, portal: 172.16.0.220,3260]
Nov 15 12:52:59 user nova-compute[75813]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6, portal: 172.16.0.220,3260] successful.
Nov 15 12:52:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed0f4c0-42fa-414a-99ad-9a408af0acb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed676afd-3d73-4df6-a94c-15dbeaad2768]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] <== disconnect_volume: return (293ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:52:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Deleting instance files /opt/stack/data/nova/instances/fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02_del
Nov 15 12:52:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Deletion of /opt/stack/data/nova/instances/fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02_del complete
Nov 15 12:52:59 user nova-compute[75813]: INFO nova.compute.manager [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Took 3.44 seconds to destroy the instance on the hypervisor.
Nov 15 12:52:59 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:52:59 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:53:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-4fac70b7-f437-4145-95b1-42ba14678d29 req-65162384-bec0-4f87-92dc-013983f1c91a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-deleted-540e4d59-b5b8-4fda-b957-00b5df385b15 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:01 user nova-compute[75813]: INFO nova.compute.manager [req-4fac70b7-f437-4145-95b1-42ba14678d29 req-65162384-bec0-4f87-92dc-013983f1c91a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Neutron deleted interface 540e4d59-b5b8-4fda-b957-00b5df385b15; detaching it from the instance and deleting it from the info cache
Nov 15 12:53:01 user nova-compute[75813]: DEBUG nova.network.neutron [req-4fac70b7-f437-4145-95b1-42ba14678d29 req-65162384-bec0-4f87-92dc-013983f1c91a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating instance_info_cache with network_info: [{"id": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "address": "fa:16:3e:8d:62:46", "network": {"id": "bef19ca8-1f1f-4ef8-a3fc-b2e3c7913bfc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-199249265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0635a5ae-c4", "ovs_interfaceid": "0635a5ae-c421-491c-9fce-56ac8b2ecec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1933fd46-434b-469e-8fb0-3b18e23266e9", "address": "fa:16:3e:05:bd:4f", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1933fd46-43", "ovs_interfaceid": "1933fd46-434b-469e-8fb0-3b18e23266e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "address": "fa:16:3e:7c:83:d9", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a3f3dd-66", "ovs_interfaceid": "d1a3f3dd-6674-41ba-bd0d-113faff3dc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "address": "fa:16:3e:dd:b7:e0", "network": {"id": "ee316a61-161f-434c-8d6a-b22bb5d87e02", "bridge": "br-int", "label": "tempest-device-tagging-net1-323657094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d2843f-9a", "ovs_interfaceid": "89d2843f-9a4c-474f-8fd2-cb4d9d48f243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "address": "fa:16:3e:d2:fc:c7", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ccbc89d-26", "ovs_interfaceid": "1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "address": "fa:16:3e:e1:59:59", "network": {"id": "98186a4f-3eab-460d-8477-fe1edd4f5a44", "bridge": "br-int", "label": "tempest-device-tagging-net2-918063745", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75d040d5bf67413aaa7185550a136c5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5af2fa9-ac", "ovs_interfaceid": "c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:53:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-4fac70b7-f437-4145-95b1-42ba14678d29 req-65162384-bec0-4f87-92dc-013983f1c91a service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Detach interface failed, port_id=540e4d59-b5b8-4fda-b957-00b5df385b15, reason: Instance fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02 could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 12:53:03 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:53:03 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Took 3.71 seconds to deallocate network for instance.
Nov 15 12:53:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ef1a9e5-1312-4ca2-a00d-5ffde8f7114e req-187d56e6-22af-4496-ba9e-9d651289e607 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-deleted-0635a5ae-c421-491c-9fce-56ac8b2ecec6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ef1a9e5-1312-4ca2-a00d-5ffde8f7114e req-187d56e6-22af-4496-ba9e-9d651289e607 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-deleted-1ccbc89d-2626-4797-a7ab-3bd3b7ed9c3c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ef1a9e5-1312-4ca2-a00d-5ffde8f7114e req-187d56e6-22af-4496-ba9e-9d651289e607 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-deleted-c5af2fa9-ac2b-455e-b599-4a0ffc8abdb2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ef1a9e5-1312-4ca2-a00d-5ffde8f7114e req-187d56e6-22af-4496-ba9e-9d651289e607 service nova] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Received event network-vif-deleted-89d2843f-9a4c-474f-8fd2-cb4d9d48f243 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:05 user nova-compute[75813]: INFO nova.compute.manager [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] [instance: fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02] Took 2.14 seconds to detach 3 volumes for instance.
Nov 15 12:53:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:05 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:53:05 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:53:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:05 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Deleted allocations for instance fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02
Nov 15 12:53:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6426513d-307c-4e86-83d9-c0a9ae9759f9 tempest-TaggedBootDevicesTest-697679330 tempest-TaggedBootDevicesTest-697679330-project-member] Lock "fb1b6d83-9508-4f62-8ae4-ea9aabd8fd02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.742s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:19 user nova-compute[75813]: INFO nova.compute.manager [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Terminating instance
Nov 15 12:53:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-b1623594-d596-485a-aa9d-6d8acc38753b req-d3dda30d-7b2d-4358-bfaa-b8e4db3fd1e7 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Received event network-vif-unplugged-63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b1623594-d596-485a-aa9d-6d8acc38753b req-d3dda30d-7b2d-4358-bfaa-b8e4db3fd1e7 service nova] Acquiring lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b1623594-d596-485a-aa9d-6d8acc38753b req-d3dda30d-7b2d-4358-bfaa-b8e4db3fd1e7 service nova] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b1623594-d596-485a-aa9d-6d8acc38753b req-d3dda30d-7b2d-4358-bfaa-b8e4db3fd1e7 service nova] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-b1623594-d596-485a-aa9d-6d8acc38753b req-d3dda30d-7b2d-4358-bfaa-b8e4db3fd1e7 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] No waiting events found dispatching network-vif-unplugged-63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:53:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-b1623594-d596-485a-aa9d-6d8acc38753b req-d3dda30d-7b2d-4358-bfaa-b8e4db3fd1e7 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Received event network-vif-unplugged-63994e7d-b489-40f0-8233-d6f6313be4ad for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:53:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Instance destroyed successfully.
Nov 15 12:53:20 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'resources' on Instance uuid 48d7cb39-a436-4b01-87cc-77e917ac5c0e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1511120876',display_name='tempest-AttachVolumeNegativeTest-server-1511120876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1511120876',id=3,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGYvlE6LK1uNKAG8XjzT6P/kpINMuPFXsxmQtweOD9s8QQNC8Jb/OjEfgk7So9RcZKEsTxHNtet5rFt45zjWd1nQUIeZ1sfNcMlxtN49JoGZsEw4YU2XZAICb99gsg+qA==',key_name='tempest-keypair-1690714560',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-qixcnjhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:47:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=48d7cb39-a436-4b01-87cc-77e917ac5c0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "63994e7d-b489-40f0-8233-d6f6313be4ad", "address": "fa:16:3e:f0:a6:95", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63994e7d-b4", "ovs_interfaceid": "63994e7d-b489-40f0-8233-d6f6313be4ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a6:95,bridge_name='br-int',has_traffic_filtering=True,id=63994e7d-b489-40f0-8233-d6f6313be4ad,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63994e7d-b4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG os_vif [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a6:95,bridge_name='br-int',has_traffic_filtering=True,id=63994e7d-b489-40f0-8233-d6f6313be4ad,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63994e7d-b4') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63994e7d-b4, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=471c61e1-dc3a-4472-91ad-b21c6729183c) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:53:20 user nova-compute[75813]: INFO os_vif [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:a6:95,bridge_name='br-int',has_traffic_filtering=True,id=63994e7d-b489-40f0-8233-d6f6313be4ad,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63994e7d-b4')
Nov 15 12:53:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Deleting instance files /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e_del
Nov 15 12:53:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Deletion of /opt/stack/data/nova/instances/48d7cb39-a436-4b01-87cc-77e917ac5c0e_del complete
Nov 15 12:53:20 user nova-compute[75813]: INFO nova.compute.manager [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 12:53:20 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:53:20 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:53:21 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:53:21 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Took 0.76 seconds to deallocate network for instance.
Nov 15 12:53:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-d51676ae-6863-4e21-a68f-cdd26493c7e6 req-5f4d1c62-294e-4504-92e0-b24fb96480d6 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Received event network-vif-deleted-63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:21 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:53:21 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:53:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:21 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Deleted allocations for instance 48d7cb39-a436-4b01-87cc-77e917ac5c0e
Nov 15 12:53:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d11dda1d-f65f-4655-9a94-d90e2869d7d8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.112s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-4412c79a-45d3-418a-a3f6-d5d18b0feec8 req-50cba40d-eeec-4845-8f99-3aa986834f71 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Received event network-vif-plugged-63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4412c79a-45d3-418a-a3f6-d5d18b0feec8 req-50cba40d-eeec-4845-8f99-3aa986834f71 service nova] Acquiring lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4412c79a-45d3-418a-a3f6-d5d18b0feec8 req-50cba40d-eeec-4845-8f99-3aa986834f71 service nova] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4412c79a-45d3-418a-a3f6-d5d18b0feec8 req-50cba40d-eeec-4845-8f99-3aa986834f71 service nova] Lock "48d7cb39-a436-4b01-87cc-77e917ac5c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-4412c79a-45d3-418a-a3f6-d5d18b0feec8 req-50cba40d-eeec-4845-8f99-3aa986834f71 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] No waiting events found dispatching network-vif-plugged-63994e7d-b489-40f0-8233-d6f6313be4ad {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:53:22 user nova-compute[75813]: WARNING nova.compute.manager [req-4412c79a-45d3-418a-a3f6-d5d18b0feec8 req-50cba40d-eeec-4845-8f99-3aa986834f71 service nova] [instance: 48d7cb39-a436-4b01-87cc-77e917ac5c0e] Received unexpected event network-vif-plugged-63994e7d-b489-40f0-8233-d6f6313be4ad for instance with vm_state deleted and task_state None.
Nov 15 12:53:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:29 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Port 1d4549cc-1d5a-4548-86d8-1832e8ce3d4c binding to destination host user is already ACTIVE {{(pid=75813) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 12:53:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:53:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquired lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:53:29 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:53:29 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating instance_info_cache with network_info: [{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:53:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Releasing lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:53:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Creating tmpfile /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/tmpvhq0ecvv to verify with other compute node that the instance is on the same shared storage. {{(pid=75813) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG nova.compute.manager [req-11bb125e-d1a4-4a35-a6ce-60c6805abef0 req-c640270f-ae9d-439b-ae78-b398fdb065a5 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-unplugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-11bb125e-d1a4-4a35-a6ce-60c6805abef0 req-c640270f-ae9d-439b-ae78-b398fdb065a5 service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-11bb125e-d1a4-4a35-a6ce-60c6805abef0 req-c640270f-ae9d-439b-ae78-b398fdb065a5 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-11bb125e-d1a4-4a35-a6ce-60c6805abef0 req-c640270f-ae9d-439b-ae78-b398fdb065a5 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG nova.compute.manager [req-11bb125e-d1a4-4a35-a6ce-60c6805abef0 req-c640270f-ae9d-439b-ae78-b398fdb065a5 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-unplugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:53:30 user nova-compute[75813]: WARNING nova.compute.manager [req-11bb125e-d1a4-4a35-a6ce-60c6805abef0 req-c640270f-ae9d-439b-ae78-b398fdb065a5 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received unexpected event network-vif-unplugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with vm_state resized and task_state resize_reverting.
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:30 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance destroyed successfully.
Nov 15 12:53:30 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lazy-loading 'resources' on Instance uuid 36b32262-4ea0-4a33-9672-82c7b8061bb1 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1881026575',display_name='tempest-ServerActionsTestOtherB-server-1881026575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1881026575',id=4,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnZCP66OrHRDZ3ufYGtTWYdbRBSuBJje4iccBj6qLgISdaiqkf+oj6TVWJiVhyyqw9aCzwVAnqyqjl+t9sQMq2PFBTOdf/G6orxxQMji4Jiz+kT9TtRhqkc6tVuBEXETA==',key_name='tempest-keypair-296274020',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e4af021f9f4272a0bf0f4f35e9d65a',ramdisk_id='',reservation_id='r-32pd9cde',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1149556653',owner_user_name='tempest-ServerActionsTestOtherB-1149556653-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:51:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfabcfa53a840b68e154b271703efe7',uuid=36b32262-4ea0-4a33-9672-82c7b8061bb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converting VIF {"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_vif [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d4549cc-1d, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f75b6cd5-acf4-4a0a-b95a-4c697239ac06) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:30 user nova-compute[75813]: INFO os_vif [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d')
Nov 15 12:53:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaXgiKyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:53:30 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[51989b7a-aaf7-4e9f-ac97-88a271193369]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:53:30 user nova-compute[75813]: No targets found.
Nov 15 12:53:30 user nova-compute[75813]: iSNS:
Nov 15 12:53:30 user nova-compute[75813]: No targets found.
Nov 15 12:53:30 user nova-compute[75813]: STATIC:
Nov 15 12:53:30 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62
Nov 15 12:53:30 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:53:30 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:53:30 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:53:30 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:53:30 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:53:30 user nova-compute[75813]: FIRMWARE:
Nov 15 12:53:30 user nova-compute[75813]: No targets found.
Nov 15 12:53:30 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:53:30 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:53:30 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c92fe16-ea53-4e29-9ec1-e29aa10f056c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95d819f-18d9-4669-94b5-90a775499d6f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:53:30 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:53:30 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:53:30 user nova-compute[75813]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:53:30 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55505d88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda'): ({'sdf'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Removing single pathed devices sdf {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[673b6589-75ec-4fe5-b92d-38c10fd001da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc4cd2f-205e-4c36-afea-5e22d92150f5]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Flushing IO for device /dev/sdf {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7beb289-e746-48c5-8fa0-3e4979d34e7f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e971f38-5da9-44d6-9bf0-77b07afcaa1f]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8169670c-1e66-4e75-8cb2-eb95b0e3bb41]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[da588bcf-4ba6-4846-bcfa-ea2f903a710b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]
Nov 15 12:53:31 user nova-compute[75813]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.
Nov 15 12:53:31 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cd1408-f7a2-4430-8c65-9a630f2329c2]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] <== disconnect_volume: return (287ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lazy-loading 'migration_context' on Instance uuid 36b32262-4ea0-4a33-9672-82c7b8061bb1 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:53:31 user nova-compute[75813]: DEBUG nova.objects.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Object Instance<36b32262-4ea0-4a33-9672-82c7b8061bb1> lazy-loaded attributes: resources,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.302s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-1acae1f1-8c82-443a-94bb-3c6377977f89 req-dfb3411c-7d74-428b-9079-ba730e041309 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1acae1f1-8c82-443a-94bb-3c6377977f89 req-dfb3411c-7d74-428b-9079-ba730e041309 service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1acae1f1-8c82-443a-94bb-3c6377977f89 req-dfb3411c-7d74-428b-9079-ba730e041309 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1acae1f1-8c82-443a-94bb-3c6377977f89 req-dfb3411c-7d74-428b-9079-ba730e041309 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-1acae1f1-8c82-443a-94bb-3c6377977f89 req-dfb3411c-7d74-428b-9079-ba730e041309 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:53:32 user nova-compute[75813]: WARNING nova.compute.manager [req-1acae1f1-8c82-443a-94bb-3c6377977f89 req-dfb3411c-7d74-428b-9079-ba730e041309 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received unexpected event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with vm_state resized and task_state resize_reverting.
Nov 15 12:53:32 user nova-compute[75813]: INFO nova.compute.manager [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Swapping old allocation on dict_keys(['55ef6276-ce17-4a96-a641-e38882572693']) held by migration d4a2e336-0ebe-44c9-91be-a231e9d41f82 for instance
Nov 15 12:53:32 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Overwriting current allocation {'allocations': {'55ef6276-ce17-4a96-a641-e38882572693': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 20}}, 'project_id': '44e4af021f9f4272a0bf0f4f35e9d65a', 'user_id': 'bcfabcfa53a840b68e154b271703efe7', 'consumer_generation': 1} on consumer 36b32262-4ea0-4a33-9672-82c7b8061bb1 {{(pid=75813) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquired lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating instance_info_cache with network_info: [{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Releasing lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG os_brick.utils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1364c8-8058-4d2b-931b-7b4fb87b7ecf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf7fbf1-e5d6-416a-88c0-95bd87b021dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22711c1-0d15-4ba6-aa68-ef6a463ca02c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[36681c55-0829-4dba-b51a-409a5fe81cd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:53:33 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:53:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3dbd2d-1f7e-4fdb-b16d-bcebb0c74112]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:53:33 user nova-compute[75813]: DEBUG os_brick.utils [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:53:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 12:53:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] There are 0 instances to clean {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 12:53:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:36 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Starting finish_revert_migration {{(pid=75813) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Start _get_guest_xml network_info=[{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': 'aa2f5a28-3010-4981-b4cb-f7d16f00582e', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaXgiKyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '36b32262-4ea0-4a33-9672-82c7b8061bb1', 'attached_at': '2023-11-15T12:53:38.000000', 'detached_at': '', 'volume_id': '2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'serial': '2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:53:37 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:53:37 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lazy-loading 'vcpu_model' on Instance uuid 36b32262-4ea0-4a33-9672-82c7b8061bb1 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaXgiKyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:53:37 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:53:37 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:53:37 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fe0404-f63a-4681-b942-db4c1ab72304]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:53:37 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60627d7-98e4-4c98-bdb5-a4c26841a226]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda] added
Nov 15 12:53:37 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed670a73-3382-442a-9d15-8dc8b25a1312]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8620654-c9d1-40f6-896a-0f8281bcaf39]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaXgiKyH {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaXgiKyH" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9a127b-303e-4bdc-9a79-00669c64548a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YaXgiKyH'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e0e5cc-f3d9-4c4a-aeeb-9c7c99bbed81]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ff00f0-7de5-4124-8608-7c04e27585ec]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:53:37 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:53:37 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e07612-8281-4503-bd13-b03e82d901ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]
Nov 15 12:53:37 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.
Nov 15 12:53:37 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fadad1-e559-4cc4-9c94-439d248d3a0b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1d93bb-adc9-44d2-859c-2336fc6ff0fa]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:53:37 user nova-compute[75813]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:53:37 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:53:37 user nova-compute[75813]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:53:37 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:53:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb99587-095d-4385-8c1a-a7e59bacb0a1]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaXgiKyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-dc165f55-347d-4e42-9d3a-f620003f70d7 req-8539dc73-4f57-4fcc-bb8b-0c7f23aaaeb0 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-changed-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-dc165f55-347d-4e42-9d3a-f620003f70d7 req-8539dc73-4f57-4fcc-bb8b-0c7f23aaaeb0 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Refreshing instance network info cache due to event network-changed-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dc165f55-347d-4e42-9d3a-f620003f70d7 req-8539dc73-4f57-4fcc-bb8b-0c7f23aaaeb0 service nova] Acquiring lock "refresh_cache-c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dc165f55-347d-4e42-9d3a-f620003f70d7 req-8539dc73-4f57-4fcc-bb8b-0c7f23aaaeb0 service nova] Acquired lock "refresh_cache-c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG nova.network.neutron [req-dc165f55-347d-4e42-9d3a-f620003f70d7 req-8539dc73-4f57-4fcc-bb8b-0c7f23aaaeb0 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Refreshing network info cache for port c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG nova.network.neutron [req-dc165f55-347d-4e42-9d3a-f620003f70d7 req-8539dc73-4f57-4fcc-bb8b-0c7f23aaaeb0 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Updated VIF entry in instance network info cache for port c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG nova.network.neutron [req-dc165f55-347d-4e42-9d3a-f620003f70d7 req-8539dc73-4f57-4fcc-bb8b-0c7f23aaaeb0 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Updating instance_info_cache with network_info: [{"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:53:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dc165f55-347d-4e42-9d3a-f620003f70d7 req-8539dc73-4f57-4fcc-bb8b-0c7f23aaaeb0 service nova] Releasing lock "refresh_cache-c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26437333230363764', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437333230363764', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1881026575',display_name='tempest-ServerActionsTestOtherB-server-1881026575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1881026575',id=4,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnZCP66OrHRDZ3ufYGtTWYdbRBSuBJje4iccBj6qLgISdaiqkf+oj6TVWJiVhyyqw9aCzwVAnqyqjl+t9sQMq2PFBTOdf/G6orxxQMji4Jiz+kT9TtRhqkc6tVuBEXETA==',key_name='tempest-keypair-296274020',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44e4af021f9f4272a0bf0f4f35e9d65a',ramdisk_id='',reservation_id='r-32pd9cde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1149556653',owner_user_name='tempest-ServerActionsTestOtherB-1149556653-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfabcfa53a840b68e154b271703efe7',uuid=36b32262-4ea0-4a33-9672-82c7b8061bb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converting VIF {"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:53:39 user nova-compute[75813]:   <uuid>36b32262-4ea0-4a33-9672-82c7b8061bb1</uuid>
Nov 15 12:53:39 user nova-compute[75813]:   <name>instance-00000004</name>
Nov 15 12:53:39 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:53:39 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:53:39 user nova-compute[75813]:   <metadata>
Nov 15 12:53:39 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:53:39 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:53:39 user nova-compute[75813]:       <nova:name>tempest-ServerActionsTestOtherB-server-1881026575</nova:name>
Nov 15 12:53:39 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:53:37</nova:creationTime>
Nov 15 12:53:39 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:53:39 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:53:39 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:53:39 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:53:39 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:53:39 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:53:39 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:53:39 user nova-compute[75813]:       <nova:owner>
Nov 15 12:53:39 user nova-compute[75813]:         <nova:user uuid="bcfabcfa53a840b68e154b271703efe7">tempest-ServerActionsTestOtherB-1149556653-project-member</nova:user>
Nov 15 12:53:39 user nova-compute[75813]:         <nova:project uuid="44e4af021f9f4272a0bf0f4f35e9d65a">tempest-ServerActionsTestOtherB-1149556653</nova:project>
Nov 15 12:53:39 user nova-compute[75813]:       </nova:owner>
Nov 15 12:53:39 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:53:39 user nova-compute[75813]:       <nova:ports>
Nov 15 12:53:39 user nova-compute[75813]:         <nova:port uuid="1d4549cc-1d5a-4548-86d8-1832e8ce3d4c">
Nov 15 12:53:39 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 12:53:39 user nova-compute[75813]:         </nova:port>
Nov 15 12:53:39 user nova-compute[75813]:       </nova:ports>
Nov 15 12:53:39 user nova-compute[75813]:     </nova:instance>
Nov 15 12:53:39 user nova-compute[75813]:   </metadata>
Nov 15 12:53:39 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:53:39 user nova-compute[75813]:     <system>
Nov 15 12:53:39 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:53:39 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:53:39 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:53:39 user nova-compute[75813]:       <entry name="serial">36b32262-4ea0-4a33-9672-82c7b8061bb1</entry>
Nov 15 12:53:39 user nova-compute[75813]:       <entry name="uuid">36b32262-4ea0-4a33-9672-82c7b8061bb1</entry>
Nov 15 12:53:39 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:53:39 user nova-compute[75813]:     </system>
Nov 15 12:53:39 user nova-compute[75813]:   </sysinfo>
Nov 15 12:53:39 user nova-compute[75813]:   <os>
Nov 15 12:53:39 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:53:39 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:53:39 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:53:39 user nova-compute[75813]:   </os>
Nov 15 12:53:39 user nova-compute[75813]:   <features>
Nov 15 12:53:39 user nova-compute[75813]:     <acpi/>
Nov 15 12:53:39 user nova-compute[75813]:     <apic/>
Nov 15 12:53:39 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:53:39 user nova-compute[75813]:   </features>
Nov 15 12:53:39 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:53:39 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:53:39 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:53:39 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:53:39 user nova-compute[75813]:   </clock>
Nov 15 12:53:39 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:53:39 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:53:39 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:53:39 user nova-compute[75813]:   </cpu>
Nov 15 12:53:39 user nova-compute[75813]:   <devices>
Nov 15 12:53:39 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:53:39 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:53:39 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk"/>
Nov 15 12:53:39 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:53:39 user nova-compute[75813]:     </disk>
Nov 15 12:53:39 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 12:53:39 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:53:39 user nova-compute[75813]:       <source dev="/dev/sdb"/>
Nov 15 12:53:39 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 12:53:39 user nova-compute[75813]:       <serial>2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda</serial>
Nov 15 12:53:39 user nova-compute[75813]:     </disk>
Nov 15 12:53:39 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:53:39 user nova-compute[75813]:       <mac address="fa:16:3e:b7:0c:d8"/>
Nov 15 12:53:39 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:53:39 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:53:39 user nova-compute[75813]:       <target dev="tap1d4549cc-1d"/>
Nov 15 12:53:39 user nova-compute[75813]:     </interface>
Nov 15 12:53:39 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:53:39 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/console.log" append="off"/>
Nov 15 12:53:39 user nova-compute[75813]:     </serial>
Nov 15 12:53:39 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:53:39 user nova-compute[75813]:     <video>
Nov 15 12:53:39 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:53:39 user nova-compute[75813]:     </video>
Nov 15 12:53:39 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:53:39 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:53:39 user nova-compute[75813]:     </rng>
Nov 15 12:53:39 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:53:39 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:53:39 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:53:39 user nova-compute[75813]:     </memballoon>
Nov 15 12:53:39 user nova-compute[75813]:   </devices>
Nov 15 12:53:39 user nova-compute[75813]: </domain>
Nov 15 12:53:39 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1881026575',display_name='tempest-ServerActionsTestOtherB-server-1881026575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1881026575',id=4,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnZCP66OrHRDZ3ufYGtTWYdbRBSuBJje4iccBj6qLgISdaiqkf+oj6TVWJiVhyyqw9aCzwVAnqyqjl+t9sQMq2PFBTOdf/G6orxxQMji4Jiz+kT9TtRhqkc6tVuBEXETA==',key_name='tempest-keypair-296274020',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44e4af021f9f4272a0bf0f4f35e9d65a',ramdisk_id='',reservation_id='r-32pd9cde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1149556653',owner_user_name='tempest-ServerActionsTestOtherB-1149556653-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfabcfa53a840b68e154b271703efe7',uuid=36b32262-4ea0-4a33-9672-82c7b8061bb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converting VIF {"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG os_vif [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '375affc4-2f58-5c8c-a7b6-868eec2195d4', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d4549cc-1d, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d4549cc-1d, col_values=(('qos', UUID('cb93702b-b495-43e2-b391-f86c04e07437')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d4549cc-1d, col_values=(('external_ids', {'iface-id': '1d4549cc-1d5a-4548-86d8-1832e8ce3d4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:0c:d8', 'vm-uuid': '36b32262-4ea0-4a33-9672-82c7b8061bb1'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:39 user nova-compute[75813]: INFO os_vif [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d')
Nov 15 12:53:39 user nova-compute[75813]: INFO nova.compute.manager [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Rebuilding instance
Nov 15 12:53:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-ca240225-42c4-46b8-a993-0ed1d3c51002 req-c1f6eb63-822a-4667-bfb5-ede10caea55a service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-unplugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ca240225-42c4-46b8-a993-0ed1d3c51002 req-c1f6eb63-822a-4667-bfb5-ede10caea55a service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ca240225-42c4-46b8-a993-0ed1d3c51002 req-c1f6eb63-822a-4667-bfb5-ede10caea55a service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ca240225-42c4-46b8-a993-0ed1d3c51002 req-c1f6eb63-822a-4667-bfb5-ede10caea55a service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-ca240225-42c4-46b8-a993-0ed1d3c51002 req-c1f6eb63-822a-4667-bfb5-ede10caea55a service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-unplugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:53:40 user nova-compute[75813]: WARNING nova.compute.manager [req-ca240225-42c4-46b8-a993-0ed1d3c51002 req-c1f6eb63-822a-4667-bfb5-ede10caea55a service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received unexpected event network-vif-unplugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with vm_state active and task_state rebuilding.
Nov 15 12:53:40 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid 870cf760-ae0c-4df1-99cf-6403d8e642ce {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Instance destroyed successfully.
Nov 15 12:53:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Updating instance_info_cache with network_info: [{"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:53:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-870cf760-ae0c-4df1-99cf-6403d8e642ce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:41 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Instance destroyed successfully.
Nov 15 12:53:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1955156344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-993680613',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb/l5B2mNfvx3ejegALfCADApCPXkMgdnx4hiGlUk/k53ie1STpv9BkOk5dWVF/By6Oa+EXAiTFeu+O7HTaL+818YoX/tvMZolR8+GdK0FQFNb1pM3ypmccc7h/vvqoMQ==',key_name='tempest-keypair-1925599135',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73fd8b6a5e5b4b1a912b5292a82ab229',ramdisk_id='',reservation_id='r-1riwgsxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1768863154',owner_user_name='tempest-ServerActionsV293TestJSON-1768863154-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5b1f2549c9478d8fb22044280d6e9e',uuid=c15606eb-006c-4a2d-9f2b-a4cc69cc6f19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converting VIF {"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_vif [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4b9b70a-52, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=554a28ef-51ff-4ad8-bc97-a347a3b6cdf2) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:53:41 user nova-compute[75813]: INFO os_vif [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52')
Nov 15 12:53:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjbkhYZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:53:41 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75813) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff70ac7-9788-44db-985d-9971b4d9f57c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:53:41 user nova-compute[75813]: No targets found.
Nov 15 12:53:41 user nova-compute[75813]: iSNS:
Nov 15 12:53:41 user nova-compute[75813]: No targets found.
Nov 15 12:53:41 user nova-compute[75813]: STATIC:
Nov 15 12:53:41 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62
Nov 15 12:53:41 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:53:41 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:53:41 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:53:41 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:53:41 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:53:41 user nova-compute[75813]: FIRMWARE:
Nov 15 12:53:41 user nova-compute[75813]: No targets found.
Nov 15 12:53:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:53:41 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:53:41 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG nova.compute.manager [req-8634ec6d-71dc-47a0-ac70-5d600a52c6f8 req-e72fcf29-55b3-44ab-b202-6f4673d42fec service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8634ec6d-71dc-47a0-ac70-5d600a52c6f8 req-e72fcf29-55b3-44ab-b202-6f4673d42fec service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8634ec6d-71dc-47a0-ac70-5d600a52c6f8 req-e72fcf29-55b3-44ab-b202-6f4673d42fec service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8634ec6d-71dc-47a0-ac70-5d600a52c6f8 req-e72fcf29-55b3-44ab-b202-6f4673d42fec service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG nova.compute.manager [req-8634ec6d-71dc-47a0-ac70-5d600a52c6f8 req-e72fcf29-55b3-44ab-b202-6f4673d42fec service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:53:41 user nova-compute[75813]: WARNING nova.compute.manager [req-8634ec6d-71dc-47a0-ac70-5d600a52c6f8 req-e72fcf29-55b3-44ab-b202-6f4673d42fec service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received unexpected event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with vm_state resized and task_state resize_reverting.
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[530185cb-a4f5-4963-ba1b-e35087d5db39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65ba72a-a3dd-4793-80f3-e52598a1759e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:53:41 user nova-compute[75813]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:53:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:53:41 user nova-compute[75813]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:53:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55307677f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62'): ({'sdg'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Removing single pathed devices sdg {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1951a9-8ee6-4e7f-bd6a-28ad3ff3a0c0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[41985c72-ceb8-40d4-9a18-312b1868d140]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Flushing IO for device /dev/sdg {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3391a0-eb8f-444a-8fce-c3eb17691311]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[76419f18-00c3-44d1-8dc7-2374319ff878]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] SCSI volumes sdg have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18c4d59-3969-44f2-b284-d18a285a9459]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b4ac44-f210-49f3-9756-eaf1cf88420b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260]
Nov 15 12:53:41 user nova-compute[75813]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260] successful.
Nov 15 12:53:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[49021ad4-f07e-440e-9257-0997c14fc5c5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] <== disconnect_volume: return (330ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:53:41 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Deleting instance files /opt/stack/data/nova/instances/c15606eb-006c-4a2d-9f2b-a4cc69cc6f19_del
Nov 15 12:53:41 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Deletion of /opt/stack/data/nova/instances/c15606eb-006c-4a2d-9f2b-a4cc69cc6f19_del complete
Nov 15 12:53:41 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance c15606eb-006c-4a2d-9f2b-a4cc69cc6f19 could not be found.
Nov 15 12:53:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjbkhYZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:53:41 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd4204f-7655-4a70-aabf-a08d1bcbc0ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:53:41 user nova-compute[75813]: No targets found.
Nov 15 12:53:41 user nova-compute[75813]: iSNS:
Nov 15 12:53:41 user nova-compute[75813]: No targets found.
Nov 15 12:53:41 user nova-compute[75813]: STATIC:
Nov 15 12:53:41 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:53:41 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:53:41 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:53:41 user nova-compute[75813]: FIRMWARE:
Nov 15 12:53:41 user nova-compute[75813]: No targets found.
Nov 15 12:53:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:53:41 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:53:41 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae20daa5-c1dc-4acc-96aa-faf27a267a85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a58abd-4f32-4d39-8e1d-14467058503d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:53:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:53:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550470a60>, {}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Disconnecting from: [] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.059s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] <== disconnect_volume: return (60ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:53:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:53:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-b55a879d-1ed2-4576-9df1-cd429fdbab09 req-501152f4-1e10-4e86-9e00-8b5e029dd407 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b55a879d-1ed2-4576-9df1-cd429fdbab09 req-501152f4-1e10-4e86-9e00-8b5e029dd407 service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b55a879d-1ed2-4576-9df1-cd429fdbab09 req-501152f4-1e10-4e86-9e00-8b5e029dd407 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b55a879d-1ed2-4576-9df1-cd429fdbab09 req-501152f4-1e10-4e86-9e00-8b5e029dd407 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-b55a879d-1ed2-4576-9df1-cd429fdbab09 req-501152f4-1e10-4e86-9e00-8b5e029dd407 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:53:42 user nova-compute[75813]: WARNING nova.compute.manager [req-b55a879d-1ed2-4576-9df1-cd429fdbab09 req-501152f4-1e10-4e86-9e00-8b5e029dd407 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received unexpected event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with vm_state active and task_state rebuilding.
Nov 15 12:53:42 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Preparing to wait for external event volume-reimaged-ced25d20-b388-4c9f-9936-ba1f29755c62 {{(pid=75813) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 12:53:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:53:42 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance running successfully.
Nov 15 12:53:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] finish_revert_migration finished successfully. {{(pid=75813) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 12:53:42 user nova-compute[75813]: INFO nova.compute.manager [None req-3d42aec5-c982-461f-8b26-c5d6061625c3 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating instance to original state: 'active'
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-c03f1e71-c2c5-4378-a07e-d3c350b1bfb4 req-b4e99eb9-9d51-4f46-ad8b-3936b3cbb8b1 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c03f1e71-c2c5-4378-a07e-d3c350b1bfb4 req-b4e99eb9-9d51-4f46-ad8b-3936b3cbb8b1 service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c03f1e71-c2c5-4378-a07e-d3c350b1bfb4 req-b4e99eb9-9d51-4f46-ad8b-3936b3cbb8b1 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c03f1e71-c2c5-4378-a07e-d3c350b1bfb4 req-b4e99eb9-9d51-4f46-ad8b-3936b3cbb8b1 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-c03f1e71-c2c5-4378-a07e-d3c350b1bfb4 req-b4e99eb9-9d51-4f46-ad8b-3936b3cbb8b1 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:53:43 user nova-compute[75813]: WARNING nova.compute.manager [req-c03f1e71-c2c5-4378-a07e-d3c350b1bfb4 req-b4e99eb9-9d51-4f46-ad8b-3936b3cbb8b1 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received unexpected event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with vm_state active and task_state None.
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:45 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:53:45 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8315MB free_disk=25.449058532714844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 870cf760-ae0c-4df1-99cf-6403d8e642ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 36b32262-4ea0-4a33-9672-82c7b8061bb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance c15606eb-006c-4a2d-9f2b-a4cc69cc6f19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 45154992-3213-43fa-89dc-d433f57ae978 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing inventories for resource provider 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating ProviderTree inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing aggregate associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, aggregates: None {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 12:53:45 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing trait associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, traits: HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 12:53:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:46 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:53:46 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:53:46 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:53:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.743s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:53:50 user nova-compute[75813]: WARNING nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Nov 15 12:53:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 870cf760-ae0c-4df1-99cf-6403d8e642ce {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 36b32262-4ea0-4a33-9672-82c7b8061bb1 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid c15606eb-006c-4a2d-9f2b-a4cc69cc6f19 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "870cf760-ae0c-4df1-99cf-6403d8e642ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:50 user nova-compute[75813]: INFO nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] During sync_power_state the instance has a pending task (rebuilding). Skip.
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-518e2cbd-12b7-44cf-a754-6f293933d868 req-84dae91a-7a2f-4463-ab36-1f1d22833017 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event volume-reimaged-ced25d20-b388-4c9f-9936-ba1f29755c62 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-518e2cbd-12b7-44cf-a754-6f293933d868 req-84dae91a-7a2f-4463-ab36-1f1d22833017 service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-518e2cbd-12b7-44cf-a754-6f293933d868 req-84dae91a-7a2f-4463-ab36-1f1d22833017 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-518e2cbd-12b7-44cf-a754-6f293933d868 req-84dae91a-7a2f-4463-ab36-1f1d22833017 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-518e2cbd-12b7-44cf-a754-6f293933d868 req-84dae91a-7a2f-4463-ab36-1f1d22833017 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Processing event volume-reimaged-ced25d20-b388-4c9f-9936-ba1f29755c62 {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG nova.compute.manager [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Instance event wait completed in 13 seconds for volume-reimaged {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:53:56 user nova-compute[75813]: INFO nova.virt.block_device [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Booting with volume ced25d20-b388-4c9f-9936-ba1f29755c62 at /dev/vda
Nov 15 12:53:56 user nova-compute[75813]: DEBUG os_brick.utils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[255d97b9-8bf6-4570-a7d7-9b0b0837e2c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c91e6dc-9691-455c-98f3-019e6654b86a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[96868cf4-c763-4ff9-a856-78852c035663]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[145b614c-914e-4740-bf33-32d15ecc429b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:53:56 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:53:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbf5884-9a59-43a3-95cf-80c6a686ad75]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG os_brick.utils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:53:56 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Updating existing volume attachment record: a287add7-3c23-4ec2-858f-edc3c8f3120e {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:53:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:54:01 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Creating image(s)
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Ensure instance console log exists: /opt/stack/data/nova/instances/c15606eb-006c-4a2d-9f2b-a4cc69cc6f19/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Start _get_guest_xml network_info=[{"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'a287add7-3c23-4ec2-858f-edc3c8f3120e', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjbkhYZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c15606eb-006c-4a2d-9f2b-a4cc69cc6f19', 'attached_at': '', 'detached_at': '', 'volume_id': 'ced25d20-b388-4c9f-9936-ba1f29755c62', 'serial': 'ced25d20-b388-4c9f-9936-ba1f29755c62'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:54:01 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 12:54:01 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.objects.instance [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lazy-loading 'vcpu_model' on Instance uuid c15606eb-006c-4a2d-9f2b-a4cc69cc6f19 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjbkhYZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:01 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:01 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:01 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a92f27-426a-4eaf-a9d3-291106b771fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:54:01 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29facc2-8270-47ef-83a7-7dc1faf4ab52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62] added
Nov 15 12:54:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e13e3b-1876-4431-8b7a-5893b801bd55]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0801b5-c9e3-4487-9183-1a147ddf1156]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjbkhYZG {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjbkhYZG" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b52a3af-b767-40b9-a554-4fb8fc51778e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjbkhYZG'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4c2ea6-8e92-412b-9a00-d58b6b2c054c]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2abe831-ae39-40ba-a286-4d35fa40a13e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3132e1-a1e4-457c-9852-878c4fab547b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260]
Nov 15 12:54:01 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260] successful.
Nov 15 12:54:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbac5d5-fb7a-44ec-ae8c-240819f0c99d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c0b5e1-615f-4e84-8eab-739a63002d36]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:01 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:01 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:01 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[764710d0-02da-4a71-a5ad-f7a88832b910]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:54:01 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjbkhYZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23639313466333938', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639313466333938', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T12:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1955156344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-993680613',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb/l5B2mNfvx3ejegALfCADApCPXkMgdnx4hiGlUk/k53ie1STpv9BkOk5dWVF/By6Oa+EXAiTFeu+O7HTaL+818YoX/tvMZolR8+GdK0FQFNb1pM3ypmccc7h/vvqoMQ==',key_name='tempest-keypair-1925599135',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73fd8b6a5e5b4b1a912b5292a82ab229',ramdisk_id='',reservation_id='r-1riwgsxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1768863154',owner_user_name='tempest-ServerActionsV293TestJSON-1768863154-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5b1f2549c9478d8fb22044280d6e9e',uuid=c15606eb-006c-4a2d-9f2b-a4cc69cc6f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converting VIF {"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:54:02 user nova-compute[75813]:   <uuid>c15606eb-006c-4a2d-9f2b-a4cc69cc6f19</uuid>
Nov 15 12:54:02 user nova-compute[75813]:   <name>instance-0000000d</name>
Nov 15 12:54:02 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:54:02 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:54:02 user nova-compute[75813]:   <metadata>
Nov 15 12:54:02 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:54:02 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:54:02 user nova-compute[75813]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1955156344</nova:name>
Nov 15 12:54:02 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:54:01</nova:creationTime>
Nov 15 12:54:02 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:54:02 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:54:02 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:54:02 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:54:02 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:54:02 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:54:02 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:54:02 user nova-compute[75813]:       <nova:owner>
Nov 15 12:54:02 user nova-compute[75813]:         <nova:user uuid="8a5b1f2549c9478d8fb22044280d6e9e">tempest-ServerActionsV293TestJSON-1768863154-project-member</nova:user>
Nov 15 12:54:02 user nova-compute[75813]:         <nova:project uuid="73fd8b6a5e5b4b1a912b5292a82ab229">tempest-ServerActionsV293TestJSON-1768863154</nova:project>
Nov 15 12:54:02 user nova-compute[75813]:       </nova:owner>
Nov 15 12:54:02 user nova-compute[75813]:       <nova:ports>
Nov 15 12:54:02 user nova-compute[75813]:         <nova:port uuid="c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe">
Nov 15 12:54:02 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 12:54:02 user nova-compute[75813]:         </nova:port>
Nov 15 12:54:02 user nova-compute[75813]:       </nova:ports>
Nov 15 12:54:02 user nova-compute[75813]:     </nova:instance>
Nov 15 12:54:02 user nova-compute[75813]:   </metadata>
Nov 15 12:54:02 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:54:02 user nova-compute[75813]:     <system>
Nov 15 12:54:02 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:54:02 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:54:02 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:54:02 user nova-compute[75813]:       <entry name="serial">c15606eb-006c-4a2d-9f2b-a4cc69cc6f19</entry>
Nov 15 12:54:02 user nova-compute[75813]:       <entry name="uuid">c15606eb-006c-4a2d-9f2b-a4cc69cc6f19</entry>
Nov 15 12:54:02 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:54:02 user nova-compute[75813]:     </system>
Nov 15 12:54:02 user nova-compute[75813]:   </sysinfo>
Nov 15 12:54:02 user nova-compute[75813]:   <os>
Nov 15 12:54:02 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:54:02 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:54:02 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:54:02 user nova-compute[75813]:   </os>
Nov 15 12:54:02 user nova-compute[75813]:   <features>
Nov 15 12:54:02 user nova-compute[75813]:     <acpi/>
Nov 15 12:54:02 user nova-compute[75813]:     <apic/>
Nov 15 12:54:02 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:54:02 user nova-compute[75813]:   </features>
Nov 15 12:54:02 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:54:02 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:54:02 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:54:02 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:54:02 user nova-compute[75813]:   </clock>
Nov 15 12:54:02 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:54:02 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:54:02 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:54:02 user nova-compute[75813]:   </cpu>
Nov 15 12:54:02 user nova-compute[75813]:   <devices>
Nov 15 12:54:02 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 12:54:02 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:02 user nova-compute[75813]:       <source dev="/dev/sdc"/>
Nov 15 12:54:02 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:54:02 user nova-compute[75813]:       <serial>ced25d20-b388-4c9f-9936-ba1f29755c62</serial>
Nov 15 12:54:02 user nova-compute[75813]:     </disk>
Nov 15 12:54:02 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:54:02 user nova-compute[75813]:       <mac address="fa:16:3e:d6:3f:4d"/>
Nov 15 12:54:02 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:02 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:54:02 user nova-compute[75813]:       <target dev="tapc4b9b70a-52"/>
Nov 15 12:54:02 user nova-compute[75813]:     </interface>
Nov 15 12:54:02 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:54:02 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/c15606eb-006c-4a2d-9f2b-a4cc69cc6f19/console.log" append="off"/>
Nov 15 12:54:02 user nova-compute[75813]:     </serial>
Nov 15 12:54:02 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:54:02 user nova-compute[75813]:     <video>
Nov 15 12:54:02 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:02 user nova-compute[75813]:     </video>
Nov 15 12:54:02 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:54:02 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:54:02 user nova-compute[75813]:     </rng>
Nov 15 12:54:02 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:54:02 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:54:02 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:54:02 user nova-compute[75813]:     </memballoon>
Nov 15 12:54:02 user nova-compute[75813]:   </devices>
Nov 15 12:54:02 user nova-compute[75813]: </domain>
Nov 15 12:54:02 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T12:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1955156344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-993680613',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb/l5B2mNfvx3ejegALfCADApCPXkMgdnx4hiGlUk/k53ie1STpv9BkOk5dWVF/By6Oa+EXAiTFeu+O7HTaL+818YoX/tvMZolR8+GdK0FQFNb1pM3ypmccc7h/vvqoMQ==',key_name='tempest-keypair-1925599135',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73fd8b6a5e5b4b1a912b5292a82ab229',ramdisk_id='',reservation_id='r-1riwgsxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1768863154',owner_user_name='tempest-ServerActionsV293TestJSON-1768863154-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5b1f2549c9478d8fb22044280d6e9e',uuid=c15606eb-006c-4a2d-9f2b-a4cc69cc6f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converting VIF {"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG os_vif [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c94ac20-0ab9-56b4-a4e8-549d06224d2a', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4b9b70a-52, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4b9b70a-52, col_values=(('qos', UUID('29fe1147-fdf4-4591-aee3-cf0ce0dbd5b7')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4b9b70a-52, col_values=(('external_ids', {'iface-id': 'c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:3f:4d', 'vm-uuid': 'c15606eb-006c-4a2d-9f2b-a4cc69cc6f19'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:02 user nova-compute[75813]: INFO os_vif [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52')
Nov 15 12:54:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] No VIF found with MAC fa:16:3e:d6:3f:4d, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:54:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-3bb41901-3f70-4437-9189-faf4549778d1 req-b6748af8-7387-4914-a9e1-b9e781ab3285 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3bb41901-3f70-4437-9189-faf4549778d1 req-b6748af8-7387-4914-a9e1-b9e781ab3285 service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3bb41901-3f70-4437-9189-faf4549778d1 req-b6748af8-7387-4914-a9e1-b9e781ab3285 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3bb41901-3f70-4437-9189-faf4549778d1 req-b6748af8-7387-4914-a9e1-b9e781ab3285 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-3bb41901-3f70-4437-9189-faf4549778d1 req-b6748af8-7387-4914-a9e1-b9e781ab3285 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:54:04 user nova-compute[75813]: WARNING nova.compute.manager [req-3bb41901-3f70-4437-9189-faf4549778d1 req-b6748af8-7387-4914-a9e1-b9e781ab3285 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received unexpected event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with vm_state active and task_state rebuild_spawning.
Nov 15 12:54:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-26a8df09-de9e-4127-a4af-f01919b4797e req-713fe19f-236b-46f1-aa1f-2776868b313e service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Received event network-changed-56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-26a8df09-de9e-4127-a4af-f01919b4797e req-713fe19f-236b-46f1-aa1f-2776868b313e service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Refreshing instance network info cache due to event network-changed-56dea8af-36d1-4ec2-be04-65a386672144. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-26a8df09-de9e-4127-a4af-f01919b4797e req-713fe19f-236b-46f1-aa1f-2776868b313e service nova] Acquiring lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-26a8df09-de9e-4127-a4af-f01919b4797e req-713fe19f-236b-46f1-aa1f-2776868b313e service nova] Acquired lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:05 user nova-compute[75813]: DEBUG nova.network.neutron [req-26a8df09-de9e-4127-a4af-f01919b4797e req-713fe19f-236b-46f1-aa1f-2776868b313e service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Refreshing network info cache for port 56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.compute.manager [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:54:06 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Instance spawned successfully.
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.network.neutron [req-26a8df09-de9e-4127-a4af-f01919b4797e req-713fe19f-236b-46f1-aa1f-2776868b313e service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updated VIF entry in instance network info cache for port 56dea8af-36d1-4ec2-be04-65a386672144. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.network.neutron [req-26a8df09-de9e-4127-a4af-f01919b4797e req-713fe19f-236b-46f1-aa1f-2776868b313e service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updating instance_info_cache with network_info: [{"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-26a8df09-de9e-4127-a4af-f01919b4797e req-713fe19f-236b-46f1-aa1f-2776868b313e service nova] Releasing lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.compute.manager [req-5e2ed4f6-e74d-4024-8314-f0fe9bac6937 req-d4dc2a02-5f2a-4c09-98c5-ab5554599255 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5e2ed4f6-e74d-4024-8314-f0fe9bac6937 req-d4dc2a02-5f2a-4c09-98c5-ab5554599255 service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5e2ed4f6-e74d-4024-8314-f0fe9bac6937 req-d4dc2a02-5f2a-4c09-98c5-ab5554599255 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5e2ed4f6-e74d-4024-8314-f0fe9bac6937 req-d4dc2a02-5f2a-4c09-98c5-ab5554599255 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.compute.manager [req-5e2ed4f6-e74d-4024-8314-f0fe9bac6937 req-d4dc2a02-5f2a-4c09-98c5-ab5554599255 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:54:06 user nova-compute[75813]: WARNING nova.compute.manager [req-5e2ed4f6-e74d-4024-8314-f0fe9bac6937 req-d4dc2a02-5f2a-4c09-98c5-ab5554599255 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received unexpected event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with vm_state active and task_state rebuild_spawning.
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.compute.manager [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG nova.objects.instance [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75813) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 12:54:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-518e2cbd-12b7-44cf-a754-6f293933d868 tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.068s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG nova.objects.instance [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:09 user nova-compute[75813]: INFO nova.compute.manager [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attaching volume a531f0af-18f9-474b-be87-2b70a4eda75f to /dev/vdb
Nov 15 12:54:09 user nova-compute[75813]: DEBUG os_brick.utils [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf2652d-56ef-4fcc-aac3-018bffcf44ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4123f14c-8017-4b6b-a57a-36d94f8f1968]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6e1f5c-f0a6-479f-93d6-efc662a159f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[22541564-7088-47a4-b93d-c70691ae55e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:09 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:54:09 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[069f9ae5-0817-49a4-9f07-728b110e2e5e]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG os_brick.utils [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:09 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updating existing volume attachment record: 6f54c9d1-2d96-4892-893c-d8de9ac7e940 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:54:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:54:14 user nova-compute[75813]: INFO nova.compute.claims [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Claim successful on node user
Nov 15 12:54:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUBbpqHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:14 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:14 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:14 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[995015a4-8933-49a0-a9e6-e398a088c89b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:54:14 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cddf86c-031a-403b-9390-1307acf45d88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f] added
Nov 15 12:54:14 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf09eef-d95e-43f2-9e52-a7e5ad374245]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[db82d993-d1ab-4654-aae9-01ef104d9594]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUBbpqHu {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUBbpqHu" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a6ff07-3bcc-4c07-99cd-9884873fa6c7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nUBbpqHu'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[15175520-b5f6-4955-bbe8-905056be9702]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c41d53-7de6-432d-a86e-63d889c2d387]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:15 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:15 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG nova.policy [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66e8cb4b92ee40b9875ac675ec63b982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb2a7b27b904d639b7df886781d587f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c75d17-59b0-448d-a9c8-8408e5f24a5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f, portal: 172.16.0.220,3260]
Nov 15 12:54:15 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f, portal: 172.16.0.220,3260] successful.
Nov 15 12:54:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a379489-70cc-4d02-b7a1-248d23f2d379]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:54:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Creating image(s)
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "/opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "/opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a58ddb-7dd3-427d-91e3-efafffdd0c4b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:15 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:15 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:15 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:15 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4327bf-eb1e-4650-b3ba-b3a86edfaa67]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUBbpqHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.200s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk 1073741824" returned: 0 in 0.049s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Successfully created port: d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:54:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Cannot resize image /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Ensure instance console log exists: /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '26162326337396432', 'path': '/dev/sdd'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162326337396432', 'path': '/dev/sdd'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.objects.instance [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:54:16 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:16 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 12:54:16 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:54:16 user nova-compute[75813]:   <serial>a531f0af-18f9-474b-be87-2b70a4eda75f</serial>
Nov 15 12:54:16 user nova-compute[75813]: </disk>
Nov 15 12:54:16 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.network.neutron [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Successfully updated port: d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "refresh_cache-4bf92268-8acd-4092-94ed-3ae2b85b4f8e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquired lock "refresh_cache-4bf92268-8acd-4092-94ed-3ae2b85b4f8e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.network.neutron [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ac0dff1-2d3f-43d7-8663-1d5a8edcbed4 req-16a0e571-498a-48b8-98f5-611ccf70c496 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Received event network-changed-d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ac0dff1-2d3f-43d7-8663-1d5a8edcbed4 req-16a0e571-498a-48b8-98f5-611ccf70c496 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Refreshing instance network info cache due to event network-changed-d6630471-bf54-4db0-9251-07ae85b91335. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ac0dff1-2d3f-43d7-8663-1d5a8edcbed4 req-16a0e571-498a-48b8-98f5-611ccf70c496 service nova] Acquiring lock "refresh_cache-4bf92268-8acd-4092-94ed-3ae2b85b4f8e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.network.neutron [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.network.neutron [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Updating instance_info_cache with network_info: [{"id": "d6630471-bf54-4db0-9251-07ae85b91335", "address": "fa:16:3e:c4:36:59", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6630471-bf", "ovs_interfaceid": "d6630471-bf54-4db0-9251-07ae85b91335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Releasing lock "refresh_cache-4bf92268-8acd-4092-94ed-3ae2b85b4f8e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Instance network_info: |[{"id": "d6630471-bf54-4db0-9251-07ae85b91335", "address": "fa:16:3e:c4:36:59", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6630471-bf", "ovs_interfaceid": "d6630471-bf54-4db0-9251-07ae85b91335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ac0dff1-2d3f-43d7-8663-1d5a8edcbed4 req-16a0e571-498a-48b8-98f5-611ccf70c496 service nova] Acquired lock "refresh_cache-4bf92268-8acd-4092-94ed-3ae2b85b4f8e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.network.neutron [req-8ac0dff1-2d3f-43d7-8663-1d5a8edcbed4 req-16a0e571-498a-48b8-98f5-611ccf70c496 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Refreshing network info cache for port d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Start _get_guest_xml network_info=[{"id": "d6630471-bf54-4db0-9251-07ae85b91335", "address": "fa:16:3e:c4:36:59", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6630471-bf", "ovs_interfaceid": "d6630471-bf54-4db0-9251-07ae85b91335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:54:16 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:54:16 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No VIF found with MAC fa:16:3e:a5:07:30, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-634746722',display_name='tempest-AttachVolumeNegativeTest-server-634746722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-634746722',id=17,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9MQmgXoZPKDWbc20pbprJlFtMrz22D9wD2k8yW8lipaBrCdDdOGzn6tUyeRXaptw9X2601lWsjZKi4+pU6myhdA+6gINEV3mJF3BltwxBJAJIg5CAebFaAff+s+7OEXA==',key_name='tempest-keypair-282939471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-3vx0dlch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=4bf92268-8acd-4092-94ed-3ae2b85b4f8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6630471-bf54-4db0-9251-07ae85b91335", "address": "fa:16:3e:c4:36:59", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6630471-bf", "ovs_interfaceid": "d6630471-bf54-4db0-9251-07ae85b91335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "d6630471-bf54-4db0-9251-07ae85b91335", "address": "fa:16:3e:c4:36:59", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6630471-bf", "ovs_interfaceid": "d6630471-bf54-4db0-9251-07ae85b91335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:36:59,bridge_name='br-int',has_traffic_filtering=True,id=d6630471-bf54-4db0-9251-07ae85b91335,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6630471-bf') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.objects.instance [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bf92268-8acd-4092-94ed-3ae2b85b4f8e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:54:16 user nova-compute[75813]:   <uuid>4bf92268-8acd-4092-94ed-3ae2b85b4f8e</uuid>
Nov 15 12:54:16 user nova-compute[75813]:   <name>instance-00000011</name>
Nov 15 12:54:16 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:54:16 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:54:16 user nova-compute[75813]:   <metadata>
Nov 15 12:54:16 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:54:16 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:54:16 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeNegativeTest-server-634746722</nova:name>
Nov 15 12:54:16 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:54:16</nova:creationTime>
Nov 15 12:54:16 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:54:16 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:54:16 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:54:16 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:54:16 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:54:16 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:54:16 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:54:16 user nova-compute[75813]:       <nova:owner>
Nov 15 12:54:16 user nova-compute[75813]:         <nova:user uuid="66e8cb4b92ee40b9875ac675ec63b982">tempest-AttachVolumeNegativeTest-1316863353-project-member</nova:user>
Nov 15 12:54:16 user nova-compute[75813]:         <nova:project uuid="9cb2a7b27b904d639b7df886781d587f">tempest-AttachVolumeNegativeTest-1316863353</nova:project>
Nov 15 12:54:16 user nova-compute[75813]:       </nova:owner>
Nov 15 12:54:16 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:54:16 user nova-compute[75813]:       <nova:ports>
Nov 15 12:54:16 user nova-compute[75813]:         <nova:port uuid="d6630471-bf54-4db0-9251-07ae85b91335">
Nov 15 12:54:16 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 12:54:16 user nova-compute[75813]:         </nova:port>
Nov 15 12:54:16 user nova-compute[75813]:       </nova:ports>
Nov 15 12:54:16 user nova-compute[75813]:     </nova:instance>
Nov 15 12:54:16 user nova-compute[75813]:   </metadata>
Nov 15 12:54:16 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:54:16 user nova-compute[75813]:     <system>
Nov 15 12:54:16 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:54:16 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:54:16 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:54:16 user nova-compute[75813]:       <entry name="serial">4bf92268-8acd-4092-94ed-3ae2b85b4f8e</entry>
Nov 15 12:54:16 user nova-compute[75813]:       <entry name="uuid">4bf92268-8acd-4092-94ed-3ae2b85b4f8e</entry>
Nov 15 12:54:16 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:54:16 user nova-compute[75813]:     </system>
Nov 15 12:54:16 user nova-compute[75813]:   </sysinfo>
Nov 15 12:54:16 user nova-compute[75813]:   <os>
Nov 15 12:54:16 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:54:16 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:54:16 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:54:16 user nova-compute[75813]:   </os>
Nov 15 12:54:16 user nova-compute[75813]:   <features>
Nov 15 12:54:16 user nova-compute[75813]:     <acpi/>
Nov 15 12:54:16 user nova-compute[75813]:     <apic/>
Nov 15 12:54:16 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:54:16 user nova-compute[75813]:   </features>
Nov 15 12:54:16 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:54:16 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:54:16 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:54:16 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:54:16 user nova-compute[75813]:   </clock>
Nov 15 12:54:16 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:54:16 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:54:16 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:54:16 user nova-compute[75813]:   </cpu>
Nov 15 12:54:16 user nova-compute[75813]:   <devices>
Nov 15 12:54:16 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:54:16 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:54:16 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk"/>
Nov 15 12:54:16 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:54:16 user nova-compute[75813]:     </disk>
Nov 15 12:54:16 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:54:16 user nova-compute[75813]:       <mac address="fa:16:3e:c4:36:59"/>
Nov 15 12:54:16 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:16 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:54:16 user nova-compute[75813]:       <target dev="tapd6630471-bf"/>
Nov 15 12:54:16 user nova-compute[75813]:     </interface>
Nov 15 12:54:16 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:54:16 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/console.log" append="off"/>
Nov 15 12:54:16 user nova-compute[75813]:     </serial>
Nov 15 12:54:16 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:54:16 user nova-compute[75813]:     <video>
Nov 15 12:54:16 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:16 user nova-compute[75813]:     </video>
Nov 15 12:54:16 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:54:16 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:54:16 user nova-compute[75813]:     </rng>
Nov 15 12:54:16 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:54:16 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:54:16 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:54:16 user nova-compute[75813]:     </memballoon>
Nov 15 12:54:16 user nova-compute[75813]:   </devices>
Nov 15 12:54:16 user nova-compute[75813]: </domain>
Nov 15 12:54:16 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-634746722',display_name='tempest-AttachVolumeNegativeTest-server-634746722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-634746722',id=17,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9MQmgXoZPKDWbc20pbprJlFtMrz22D9wD2k8yW8lipaBrCdDdOGzn6tUyeRXaptw9X2601lWsjZKi4+pU6myhdA+6gINEV3mJF3BltwxBJAJIg5CAebFaAff+s+7OEXA==',key_name='tempest-keypair-282939471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-3vx0dlch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=4bf92268-8acd-4092-94ed-3ae2b85b4f8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6630471-bf54-4db0-9251-07ae85b91335", "address": "fa:16:3e:c4:36:59", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6630471-bf", "ovs_interfaceid": "d6630471-bf54-4db0-9251-07ae85b91335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "d6630471-bf54-4db0-9251-07ae85b91335", "address": "fa:16:3e:c4:36:59", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6630471-bf", "ovs_interfaceid": "d6630471-bf54-4db0-9251-07ae85b91335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:36:59,bridge_name='br-int',has_traffic_filtering=True,id=d6630471-bf54-4db0-9251-07ae85b91335,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6630471-bf') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG os_vif [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:36:59,bridge_name='br-int',has_traffic_filtering=True,id=d6630471-bf54-4db0-9251-07ae85b91335,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6630471-bf') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b45b947-5a04-5f6b-b9ec-61d8a62a0025', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6630471-bf, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6630471-bf, col_values=(('qos', UUID('f7a5fa44-6ee4-4fad-a18a-7b297d08dd9d')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6630471-bf, col_values=(('external_ids', {'iface-id': 'd6630471-bf54-4db0-9251-07ae85b91335', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:36:59', 'vm-uuid': '4bf92268-8acd-4092-94ed-3ae2b85b4f8e'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:17 user nova-compute[75813]: INFO os_vif [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:36:59,bridge_name='br-int',has_traffic_filtering=True,id=d6630471-bf54-4db0-9251-07ae85b91335,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6630471-bf')
Nov 15 12:54:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No VIF found with MAC fa:16:3e:c4:36:59, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea365b84-16cf-4635-acd0-fe281ad32dde tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.555s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG nova.network.neutron [req-8ac0dff1-2d3f-43d7-8663-1d5a8edcbed4 req-16a0e571-498a-48b8-98f5-611ccf70c496 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Updated VIF entry in instance network info cache for port d6630471-bf54-4db0-9251-07ae85b91335. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG nova.network.neutron [req-8ac0dff1-2d3f-43d7-8663-1d5a8edcbed4 req-16a0e571-498a-48b8-98f5-611ccf70c496 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Updating instance_info_cache with network_info: [{"id": "d6630471-bf54-4db0-9251-07ae85b91335", "address": "fa:16:3e:c4:36:59", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6630471-bf", "ovs_interfaceid": "d6630471-bf54-4db0-9251-07ae85b91335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ac0dff1-2d3f-43d7-8663-1d5a8edcbed4 req-16a0e571-498a-48b8-98f5-611ccf70c496 service nova] Releasing lock "refresh_cache-4bf92268-8acd-4092-94ed-3ae2b85b4f8e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-7e9ff2d8-e649-4581-8f41-77e3ee2ca355 req-697831d8-00e9-4ecb-8e5d-fe4b401ed0b1 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Received event network-vif-plugged-d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e9ff2d8-e649-4581-8f41-77e3ee2ca355 req-697831d8-00e9-4ecb-8e5d-fe4b401ed0b1 service nova] Acquiring lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e9ff2d8-e649-4581-8f41-77e3ee2ca355 req-697831d8-00e9-4ecb-8e5d-fe4b401ed0b1 service nova] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e9ff2d8-e649-4581-8f41-77e3ee2ca355 req-697831d8-00e9-4ecb-8e5d-fe4b401ed0b1 service nova] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-7e9ff2d8-e649-4581-8f41-77e3ee2ca355 req-697831d8-00e9-4ecb-8e5d-fe4b401ed0b1 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] No waiting events found dispatching network-vif-plugged-d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:54:18 user nova-compute[75813]: WARNING nova.compute.manager [req-7e9ff2d8-e649-4581-8f41-77e3ee2ca355 req-697831d8-00e9-4ecb-8e5d-fe4b401ed0b1 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Received unexpected event network-vif-plugged-d6630471-bf54-4db0-9251-07ae85b91335 for instance with vm_state building and task_state spawning.
Nov 15 12:54:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:54:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Instance spawned successfully.
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-3095091c-d84b-4832-b497-61012fef0ffc req-f4cd898f-20d7-450c-a585-7ae4fed14e1c service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Received event network-vif-plugged-d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3095091c-d84b-4832-b497-61012fef0ffc req-f4cd898f-20d7-450c-a585-7ae4fed14e1c service nova] Acquiring lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3095091c-d84b-4832-b497-61012fef0ffc req-f4cd898f-20d7-450c-a585-7ae4fed14e1c service nova] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3095091c-d84b-4832-b497-61012fef0ffc req-f4cd898f-20d7-450c-a585-7ae4fed14e1c service nova] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-3095091c-d84b-4832-b497-61012fef0ffc req-f4cd898f-20d7-450c-a585-7ae4fed14e1c service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] No waiting events found dispatching network-vif-plugged-d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:54:20 user nova-compute[75813]: WARNING nova.compute.manager [req-3095091c-d84b-4832-b497-61012fef0ffc req-f4cd898f-20d7-450c-a585-7ae4fed14e1c service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Received unexpected event network-vif-plugged-d6630471-bf54-4db0-9251-07ae85b91335 for instance with vm_state building and task_state spawning.
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:54:20 user nova-compute[75813]: INFO nova.compute.manager [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 15 12:54:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:54:21 user nova-compute[75813]: INFO nova.compute.manager [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Took 6.58 seconds to build instance.
Nov 15 12:54:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-64ca5b17-57c5-4c2b-a2f5-0f53225668dc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.688s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-c01a7de5-0b19-4870-a7ea-e9578a4874ec req-8a3f322a-c020-4889-861f-bd66bc7a9c41 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-changed-637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-c01a7de5-0b19-4870-a7ea-e9578a4874ec req-8a3f322a-c020-4889-861f-bd66bc7a9c41 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Refreshing instance network info cache due to event network-changed-637149a0-24b9-4fed-8cc4-6dd3a909c874. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c01a7de5-0b19-4870-a7ea-e9578a4874ec req-8a3f322a-c020-4889-861f-bd66bc7a9c41 service nova] Acquiring lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c01a7de5-0b19-4870-a7ea-e9578a4874ec req-8a3f322a-c020-4889-861f-bd66bc7a9c41 service nova] Acquired lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:21 user nova-compute[75813]: DEBUG nova.network.neutron [req-c01a7de5-0b19-4870-a7ea-e9578a4874ec req-8a3f322a-c020-4889-861f-bd66bc7a9c41 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Refreshing network info cache for port 637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:22 user nova-compute[75813]: DEBUG nova.network.neutron [req-c01a7de5-0b19-4870-a7ea-e9578a4874ec req-8a3f322a-c020-4889-861f-bd66bc7a9c41 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updated VIF entry in instance network info cache for port 637149a0-24b9-4fed-8cc4-6dd3a909c874. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:54:22 user nova-compute[75813]: DEBUG nova.network.neutron [req-c01a7de5-0b19-4870-a7ea-e9578a4874ec req-8a3f322a-c020-4889-861f-bd66bc7a9c41 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updating instance_info_cache with network_info: [{"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c01a7de5-0b19-4870-a7ea-e9578a4874ec req-8a3f322a-c020-4889-861f-bd66bc7a9c41 service nova] Releasing lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "interface-868f2db9-e52c-4f9a-8bd3-18ec6807377e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "interface-868f2db9-e52c-4f9a-8bd3-18ec6807377e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:22 user nova-compute[75813]: DEBUG nova.objects.instance [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lazy-loading 'flavor' on Instance uuid 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:22 user nova-compute[75813]: DEBUG nova.objects.instance [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lazy-loading 'pci_requests' on Instance uuid 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:22 user nova-compute[75813]: DEBUG nova.objects.base [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Object Instance<868f2db9-e52c-4f9a-8bd3-18ec6807377e> lazy-loaded attributes: flavor,pci_requests {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 12:54:22 user nova-compute[75813]: DEBUG nova.network.neutron [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:54:22 user nova-compute[75813]: DEBUG nova.policy [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74615b8601894772b20328f7b894c9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce97b303bdb940c59d6cea5ad91ef0d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:54:23 user nova-compute[75813]: DEBUG nova.network.neutron [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Successfully created port: b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:54:23 user nova-compute[75813]: DEBUG nova.network.neutron [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Successfully updated port: b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquired lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.network.neutron [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-38ef93b3-23ff-4e0d-8bc6-9f35e2296abe req-98b326ae-362c-4ae2-b412-3818c35dd797 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-changed-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-38ef93b3-23ff-4e0d-8bc6-9f35e2296abe req-98b326ae-362c-4ae2-b412-3818c35dd797 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Refreshing instance network info cache due to event network-changed-b46434a3-ad87-45e7-bbb1-a01ac2a871d7. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38ef93b3-23ff-4e0d-8bc6-9f35e2296abe req-98b326ae-362c-4ae2-b412-3818c35dd797 service nova] Acquiring lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.network.neutron [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updating instance_info_cache with network_info: [{"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Releasing lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38ef93b3-23ff-4e0d-8bc6-9f35e2296abe req-98b326ae-362c-4ae2-b412-3818c35dd797 service nova] Acquired lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.network.neutron [req-38ef93b3-23ff-4e0d-8bc6-9f35e2296abe req-98b326ae-362c-4ae2-b412-3818c35dd797 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Refreshing network info cache for port b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211354557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211354557',id=15,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy1dLT3BMBPj0HMd2wO6SlIfeOmZ5zLbEAioS6Myt1UETKqLiMh/MFli0JtJDPjUkaSiV8utv6xgh1ZfE1PdfxOgyxPJzAm7dYkPDYpHgRwmjqP16hyPEVizDOZD284gw==',key_name='tempest-keypair-1348731404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce97b303bdb940c59d6cea5ad91ef0d4',ramdisk_id='',reservation_id='r-mq0pxr7o',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179121499',owner_user_name='tempest-TaggedAttachmentsTest-1179121499-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74615b8601894772b20328f7b894c9a1',uuid=868f2db9-e52c-4f9a-8bd3-18ec6807377e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converting VIF {"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG os_vif [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ff8b9c8-b0a7-5912-89da-ff93a86d1709', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb46434a3-ad, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb46434a3-ad, col_values=(('qos', UUID('a1330e61-0942-479d-baa0-0597b7c37479')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb46434a3-ad, col_values=(('external_ids', {'iface-id': 'b46434a3-ad87-45e7-bbb1-a01ac2a871d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:bb:ea', 'vm-uuid': '868f2db9-e52c-4f9a-8bd3-18ec6807377e'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:24 user nova-compute[75813]: INFO os_vif [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad')
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211354557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211354557',id=15,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy1dLT3BMBPj0HMd2wO6SlIfeOmZ5zLbEAioS6Myt1UETKqLiMh/MFli0JtJDPjUkaSiV8utv6xgh1ZfE1PdfxOgyxPJzAm7dYkPDYpHgRwmjqP16hyPEVizDOZD284gw==',key_name='tempest-keypair-1348731404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce97b303bdb940c59d6cea5ad91ef0d4',ramdisk_id='',reservation_id='r-mq0pxr7o',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179121499',owner_user_name='tempest-TaggedAttachmentsTest-1179121499-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74615b8601894772b20328f7b894c9a1',uuid=868f2db9-e52c-4f9a-8bd3-18ec6807377e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converting VIF {"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] attach device xml: <interface type="ethernet">
Nov 15 12:54:24 user nova-compute[75813]:   <mac address="fa:16:3e:05:bb:ea"/>
Nov 15 12:54:24 user nova-compute[75813]:   <model type="virtio"/>
Nov 15 12:54:24 user nova-compute[75813]:   <mtu size="1442"/>
Nov 15 12:54:24 user nova-compute[75813]:   <target dev="tapb46434a3-ad"/>
Nov 15 12:54:24 user nova-compute[75813]: </interface>
Nov 15 12:54:24 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:54:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] No BDM found with device name hda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] No VIF found with MAC fa:16:3e:e0:6d:60, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:54:25 user nova-compute[75813]:   <nova:package version="0.0.0"/>
Nov 15 12:54:25 user nova-compute[75813]:   <nova:name>tempest-device-tagging-server-211354557</nova:name>
Nov 15 12:54:25 user nova-compute[75813]:   <nova:creationTime>2023-11-15 12:54:25</nova:creationTime>
Nov 15 12:54:25 user nova-compute[75813]:   <nova:flavor name="m1.tiny">
Nov 15 12:54:25 user nova-compute[75813]:     <nova:memory>512</nova:memory>
Nov 15 12:54:25 user nova-compute[75813]:     <nova:disk>1</nova:disk>
Nov 15 12:54:25 user nova-compute[75813]:     <nova:swap>0</nova:swap>
Nov 15 12:54:25 user nova-compute[75813]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:54:25 user nova-compute[75813]:     <nova:vcpus>1</nova:vcpus>
Nov 15 12:54:25 user nova-compute[75813]:   </nova:flavor>
Nov 15 12:54:25 user nova-compute[75813]:   <nova:owner>
Nov 15 12:54:25 user nova-compute[75813]:     <nova:user uuid="74615b8601894772b20328f7b894c9a1">tempest-TaggedAttachmentsTest-1179121499-project-member</nova:user>
Nov 15 12:54:25 user nova-compute[75813]:     <nova:project uuid="ce97b303bdb940c59d6cea5ad91ef0d4">tempest-TaggedAttachmentsTest-1179121499</nova:project>
Nov 15 12:54:25 user nova-compute[75813]:   </nova:owner>
Nov 15 12:54:25 user nova-compute[75813]:   <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:54:25 user nova-compute[75813]:   <nova:ports>
Nov 15 12:54:25 user nova-compute[75813]:     <nova:port uuid="637149a0-24b9-4fed-8cc4-6dd3a909c874">
Nov 15 12:54:25 user nova-compute[75813]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 12:54:25 user nova-compute[75813]:     </nova:port>
Nov 15 12:54:25 user nova-compute[75813]:     <nova:port uuid="b46434a3-ad87-45e7-bbb1-a01ac2a871d7">
Nov 15 12:54:25 user nova-compute[75813]:       <nova:ip type="fixed" address="10.10.10.25" ipVersion="4"/>
Nov 15 12:54:25 user nova-compute[75813]:     </nova:port>
Nov 15 12:54:25 user nova-compute[75813]:   </nova:ports>
Nov 15 12:54:25 user nova-compute[75813]: </nova:instance>
Nov 15 12:54:25 user nova-compute[75813]:  {{(pid=75813) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-78cc951a-19b2-497f-9772-d9030abb027b tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "interface-868f2db9-e52c-4f9a-8bd3-18ec6807377e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.990s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG nova.network.neutron [req-38ef93b3-23ff-4e0d-8bc6-9f35e2296abe req-98b326ae-362c-4ae2-b412-3818c35dd797 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updated VIF entry in instance network info cache for port b46434a3-ad87-45e7-bbb1-a01ac2a871d7. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG nova.network.neutron [req-38ef93b3-23ff-4e0d-8bc6-9f35e2296abe req-98b326ae-362c-4ae2-b412-3818c35dd797 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updating instance_info_cache with network_info: [{"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38ef93b3-23ff-4e0d-8bc6-9f35e2296abe req-98b326ae-362c-4ae2-b412-3818c35dd797 service nova] Releasing lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG nova.objects.instance [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lazy-loading 'flavor' on Instance uuid 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:26 user nova-compute[75813]: INFO nova.compute.manager [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Attaching volume 1f397238-fb52-46ac-b97c-c2a1933bc408 to /dev/vdb
Nov 15 12:54:26 user nova-compute[75813]: DEBUG os_brick.utils [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[200cad60-2e35-4b4d-8bbc-c4b77029fef1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7700300d-6d72-48d8-bc9b-6aea3c5e7603]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad5b84f-2bea-4fa8-83c8-60685a7c6781]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cb83ba-c3df-4571-bcf0-93f839c88bd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-vif-plugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] No waiting events found dispatching network-vif-plugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:54:26 user nova-compute[75813]: WARNING nova.compute.manager [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received unexpected event network-vif-plugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 for instance with vm_state active and task_state None.
Nov 15 12:54:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-vif-plugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] No waiting events found dispatching network-vif-plugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:54:26 user nova-compute[75813]: WARNING nova.compute.manager [req-c09cbb65-d115-4157-afd9-f77d378bd43c req-a6b65fdf-4254-4636-9fdd-16f20e449203 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received unexpected event network-vif-plugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 for instance with vm_state active and task_state None.
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:26 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:54:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eebd279-4107-4bce-b4dc-2157c63b42d9]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG os_brick.utils [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:26 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updating existing volume attachment record: f25f256c-98ac-49f7-82c8-45e8acfff08b {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:54:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:28 user nova-compute[75813]: INFO nova.compute.manager [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Detaching volume a531f0af-18f9-474b-be87-2b70a4eda75f
Nov 15 12:54:28 user nova-compute[75813]: INFO nova.virt.block_device [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attempting to driver detach volume a531f0af-18f9-474b-be87-2b70a4eda75f from mountpoint /dev/vdb
Nov 15 12:54:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Attempting to detach device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:54:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:54:28 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:28 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 12:54:28 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:54:28 user nova-compute[75813]:   <serial>a531f0af-18f9-474b-be87-2b70a4eda75f</serial>
Nov 15 12:54:28 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:54:28 user nova-compute[75813]: </disk>
Nov 15 12:54:28 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:54:28 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Successfully detached device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the persistent domain config.
Nov 15 12:54:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45154992-3213-43fa-89dc-d433f57ae978 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:54:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:54:28 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:28 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 12:54:28 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:54:28 user nova-compute[75813]:   <serial>a531f0af-18f9-474b-be87-2b70a4eda75f</serial>
Nov 15 12:54:28 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:54:28 user nova-compute[75813]: </disk>
Nov 15 12:54:28 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:54:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:54:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-076ef292-7a72-4044-9c81-0180cc17c7df req-c3204d1e-2228-4ee4-911b-dd78d13ca884 service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Received event network-changed-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-076ef292-7a72-4044-9c81-0180cc17c7df req-c3204d1e-2228-4ee4-911b-dd78d13ca884 service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Refreshing instance network info cache due to event network-changed-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-076ef292-7a72-4044-9c81-0180cc17c7df req-c3204d1e-2228-4ee4-911b-dd78d13ca884 service nova] Acquiring lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-076ef292-7a72-4044-9c81-0180cc17c7df req-c3204d1e-2228-4ee4-911b-dd78d13ca884 service nova] Acquired lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG nova.network.neutron [req-076ef292-7a72-4044-9c81-0180cc17c7df req-c3204d1e-2228-4ee4-911b-dd78d13ca884 service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Refreshing network info cache for port 6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUcrqBzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:31 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:31 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:31 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05d052f-1886-403b-96f8-afe124d978c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:54:31 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b030c973-d4f1-47b5-98e4-37539a37fb9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408] added
Nov 15 12:54:31 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8d24a8-a626-4d72-b8e1-34eb64619e1d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[000cdf77-9ef0-4d74-a75b-d6955d28e659]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUcrqBzh {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUcrqBzh" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acde4c4-d258-4973-8be1-b91a059252c9]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iUcrqBzh'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[31823393-12b5-4250-9ecf-ca086e21d33e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f984d4-daf6-49db-996a-d10670f9d04b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:31 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:31 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:31 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:31 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:31 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:31 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e342ac-8e8f-45c1-8b1f-971d26b21d24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408, portal: 172.16.0.220,3260]
Nov 15 12:54:31 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408, portal: 172.16.0.220,3260] successful.
Nov 15 12:54:31 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8be73e0-e270-40d6-bb83-29f8e3d5e0b7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[31672fe6-0bff-4b39-b188-14396d85eda6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:31 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:31 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:31 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:31 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:31 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:31 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:31 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:31 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c93408a-f669-477b-8265-a565364867e5]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUcrqBzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG nova.network.neutron [req-076ef292-7a72-4044-9c81-0180cc17c7df req-c3204d1e-2228-4ee4-911b-dd78d13ca884 service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Updated VIF entry in instance network info cache for port 6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG nova.network.neutron [req-076ef292-7a72-4044-9c81-0180cc17c7df req-c3204d1e-2228-4ee4-911b-dd78d13ca884 service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Updating instance_info_cache with network_info: [{"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-076ef292-7a72-4044-9c81-0180cc17c7df req-c3204d1e-2228-4ee4-911b-dd78d13ca884 service nova] Releasing lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23062373434663730', 'path': '/dev/sde'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062373434663730', 'path': '/dev/sde'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:54:32 user nova-compute[75813]: DEBUG nova.objects.instance [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lazy-loading 'flavor' on Instance uuid 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:54:32 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:32 user nova-compute[75813]:   <source dev="/dev/sde"/>
Nov 15 12:54:32 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:54:32 user nova-compute[75813]:   <serial>1f397238-fb52-46ac-b97c-c2a1933bc408</serial>
Nov 15 12:54:32 user nova-compute[75813]: </disk>
Nov 15 12:54:32 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:54:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] No BDM found with device name hda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] No VIF found with MAC fa:16:3e:e0:6d:60, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:54:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cbec76c4-cbe3-4371-a038-b3202fefc9a8 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.060s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:33 user nova-compute[75813]: DEBUG nova.objects.instance [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lazy-loading 'flavor' on Instance uuid 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:34 user nova-compute[75813]: INFO nova.compute.manager [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Attaching volume 40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 to /dev/vdb
Nov 15 12:54:34 user nova-compute[75813]: DEBUG os_brick.utils [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0985961-0c3a-40a7-9e01-3a1ca06be383]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a976be-bd48-4aa4-8e53-2134723a81d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b97bed7-f3d6-4e0b-a004-0b1f23e0947c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0f92aa-b5bb-4df4-8751-7a211371e713]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:34 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd377b4-1405-4590-b9aa-fc94fa533a85]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG os_brick.utils [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Updating existing volume attachment record: 1f98b320-e01a-4239-9a32-76f1f8ce973d {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:34 user nova-compute[75813]: INFO nova.compute.manager [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Detaching volume 1f397238-fb52-46ac-b97c-c2a1933bc408
Nov 15 12:54:34 user nova-compute[75813]: INFO nova.virt.block_device [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Attempting to driver detach volume 1f397238-fb52-46ac-b97c-c2a1933bc408 from mountpoint /dev/vdb
Nov 15 12:54:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Attempting to detach device vdb from instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:54:34 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:34 user nova-compute[75813]:   <source dev="/dev/sde"/>
Nov 15 12:54:34 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:54:34 user nova-compute[75813]:   <serial>1f397238-fb52-46ac-b97c-c2a1933bc408</serial>
Nov 15 12:54:34 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 12:54:34 user nova-compute[75813]: </disk>
Nov 15 12:54:34 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:54:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Successfully detached device vdb from instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e from the persistent domain config.
Nov 15 12:54:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:54:34 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:34 user nova-compute[75813]:   <source dev="/dev/sde"/>
Nov 15 12:54:34 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:54:34 user nova-compute[75813]:   <serial>1f397238-fb52-46ac-b97c-c2a1933bc408</serial>
Nov 15 12:54:34 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 12:54:34 user nova-compute[75813]: </disk>
Nov 15 12:54:34 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:54:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:54:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "794722de-e692-49f8-8bc9-ff64854ec405" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:54:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:38 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:54:38 user nova-compute[75813]: INFO nova.compute.claims [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Claim successful on node user
Nov 15 12:54:38 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:54:38 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:54:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:54:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:54:38 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:54:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:54:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:54:39 user nova-compute[75813]: INFO nova.virt.block_device [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Booting with volume 848ab383-3042-43de-9652-8073233fae09 at /dev/vda
Nov 15 12:54:39 user nova-compute[75813]: DEBUG nova.policy [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e544761c815a47c2b414141e839dee47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baca56dbe0004f82b45bd165781ff06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htCjqHai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:39 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:39 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:39 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.utils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0695ee-e7e9-4c75-853e-6e5df0ff6be5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:54:39 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b938fd51-da55-49ce-a971-d9a3aaf0c126]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6389bb-fffb-4c8c-9efd-18c43ad5c49f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1] added
Nov 15 12:54:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[904c3046-f4d7-43ad-9c54-57b9366b27b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f90063-5d05-4b25-9750-8eba373e550a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0de5c68-3e2a-471b-a4c3-abeb21ca91ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[99602fe5-c8bb-42b5-b805-efa51fa2b85c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a3f7fd-1a7b-4227-9b52-27942b32ad49]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v htCjqHai {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:39 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcf218d-b5f5-42e0-a3b9-ada0d3aa43fd]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.utils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating existing volume attachment record: 50f20d56-780a-4097-aed1-c216a3214efc {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v htCjqHai" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e53713-ceb2-4c74-a141-9e257f8b76cd]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'htCjqHai'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c12604c-5afc-45d5-8ea3-7df21fb85e14]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca9e6d7-b1ad-42eb-b3af-2ba5621fd6ed]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dd0d0f-bcae-4d2d-8a3f-dfc5ed5e3e09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1, portal: 172.16.0.220,3260]
Nov 15 12:54:39 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1, portal: 172.16.0.220,3260] successful.
Nov 15 12:54:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1bc05a-5917-4705-8297-37fc67ee48e4]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[245ba753-fbb1-4216-93b6-9a112c5a3276]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:39 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9df050-7231-499e-afe9-e36d5fe319ef]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htCjqHai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully created port: 343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:54:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23236326537373138', 'path': '/dev/sdf'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236326537373138', 'path': '/dev/sdf'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG nova.objects.instance [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lazy-loading 'flavor' on Instance uuid 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:54:40 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:40 user nova-compute[75813]:   <source dev="/dev/sdf"/>
Nov 15 12:54:40 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:54:40 user nova-compute[75813]:   <serial>40207771-5d0d-4e6d-9cf8-e2bf8d43aae1</serial>
Nov 15 12:54:40 user nova-compute[75813]: </disk>
Nov 15 12:54:40 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully created port: 2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] No VIF found with MAC fa:16:3e:bc:9b:92, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ec6bcb78-e79a-4a3b-ac51-50d5fb2a503e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.974s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully created port: b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating instance_info_cache with network_info: [{"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-36b32262-4ea0-4a33-9672-82c7b8061bb1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully created port: c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:54:42 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:54:42 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:54:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:42 user nova-compute[75813]: INFO nova.compute.manager [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Detaching volume 40207771-5d0d-4e6d-9cf8-e2bf8d43aae1
Nov 15 12:54:42 user nova-compute[75813]: INFO nova.virt.block_device [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Attempting to driver detach volume 40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 from mountpoint /dev/vdb
Nov 15 12:54:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Attempting to detach device vdb from instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:54:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:54:42 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:42 user nova-compute[75813]:   <source dev="/dev/sdf"/>
Nov 15 12:54:42 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:54:42 user nova-compute[75813]:   <serial>40207771-5d0d-4e6d-9cf8-e2bf8d43aae1</serial>
Nov 15 12:54:42 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:54:42 user nova-compute[75813]: </disk>
Nov 15 12:54:42 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:54:42 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Successfully detached device vdb from instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa from the persistent domain config.
Nov 15 12:54:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:54:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:54:42 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:42 user nova-compute[75813]:   <source dev="/dev/sdf"/>
Nov 15 12:54:42 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:54:42 user nova-compute[75813]:   <serial>40207771-5d0d-4e6d-9cf8-e2bf8d43aae1</serial>
Nov 15 12:54:42 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:54:42 user nova-compute[75813]: </disk>
Nov 15 12:54:42 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:54:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully created port: d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:54:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:54:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully updated port: 343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:54:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-17908a07-0d43-48ad-b6bb-475648d3d62d req-f7bc894e-bcee-4c8e-bc5e-873206c5ba9d service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-changed-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-17908a07-0d43-48ad-b6bb-475648d3d62d req-f7bc894e-bcee-4c8e-bc5e-873206c5ba9d service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing instance network info cache due to event network-changed-343ad4aa-1f1e-4a58-88fa-d9ec606277e6. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-17908a07-0d43-48ad-b6bb-475648d3d62d req-f7bc894e-bcee-4c8e-bc5e-873206c5ba9d service nova] Acquiring lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-17908a07-0d43-48ad-b6bb-475648d3d62d req-f7bc894e-bcee-4c8e-bc5e-873206c5ba9d service nova] Acquired lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-17908a07-0d43-48ad-b6bb-475648d3d62d req-f7bc894e-bcee-4c8e-bc5e-873206c5ba9d service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing network info cache for port 343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-17908a07-0d43-48ad-b6bb-475648d3d62d req-f7bc894e-bcee-4c8e-bc5e-873206c5ba9d service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:54:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-17908a07-0d43-48ad-b6bb-475648d3d62d req-f7bc894e-bcee-4c8e-bc5e-873206c5ba9d service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-17908a07-0d43-48ad-b6bb-475648d3d62d req-f7bc894e-bcee-4c8e-bc5e-873206c5ba9d service nova] Releasing lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully updated port: c283df15-5363-4933-b3c1-95201604f7b2 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:44 user nova-compute[75813]: INFO nova.virt.block_device [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Booting with volume 75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 at /dev/vdb
Nov 15 12:54:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully updated port: c1044bb7-bc9d-4730-b0e4-fd2b50fece18 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG os_brick.utils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[99617272-a122-449c-9b4a-8969780f5279]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdc0861-07ae-4ba2-b801-68e6fc663c03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b306b7d3-316a-47c5-9126-d5c1e1197f6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebddf21-5985-4543-8e6d-a3efbb800b4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:44 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb1f276-aa76-4336-8941-ebfa9d8a7241]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG os_brick.utils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating existing volume attachment record: 303cfea0-6945-490a-9071-4603b447b0f9 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully updated port: 2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-changed-c283df15-5363-4933-b3c1-95201604f7b2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing instance network info cache due to event network-changed-c283df15-5363-4933-b3c1-95201604f7b2. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] Acquiring lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] Acquired lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing network info cache for port c283df15-5363-4933-b3c1-95201604f7b2 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully updated port: b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] Releasing lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-changed-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing instance network info cache due to event network-changed-c1044bb7-bc9d-4730-b0e4-fd2b50fece18. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] Acquiring lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] Acquired lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing network info cache for port c1044bb7-bc9d-4730-b0e4-fd2b50fece18 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] Releasing lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-changed-2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing instance network info cache due to event network-changed-2bdba87c-b645-4d17-9470-a5c9d8b7341e. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] Acquiring lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] Acquired lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing network info cache for port 2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully updated port: c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG nova.network.neutron [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2953e2e-09bb-4bc7-bbb8-c6b99d51c212 req-e02e5681-3fb3-43ee-adac-2b2d7a53dea1 service nova] Releasing lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Successfully updated port: d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:54:46 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:54:46 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:54:46 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7950MB free_disk=25.391223907470703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquired lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 870cf760-ae0c-4df1-99cf-6403d8e642ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 36b32262-4ea0-4a33-9672-82c7b8061bb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance c15606eb-006c-4a2d-9f2b-a4cc69cc6f19 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 45154992-3213-43fa-89dc-d433f57ae978 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4bf92268-8acd-4092-94ed-3ae2b85b4f8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 794722de-e692-49f8-8bc9-ff64854ec405 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-changed-b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing instance network info cache due to event network-changed-b22b7864-5cdf-4a54-a11e-13cfa447176d. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] Acquiring lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:54:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating instance_info_cache with network_info: [{"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:48 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45154992-3213-43fa-89dc-d433f57ae978 is timed out.
Nov 15 12:54:48 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Successfully detached device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the live domain config.
Nov 15 12:54:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Releasing lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Instance network_info: |[{"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] Acquired lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing network info cache for port b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUBbpqHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:48 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01be6cd-ea3f-4423-a49e-c01c7574dab7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:54:48 user nova-compute[75813]: No targets found.
Nov 15 12:54:48 user nova-compute[75813]: iSNS:
Nov 15 12:54:48 user nova-compute[75813]: No targets found.
Nov 15 12:54:48 user nova-compute[75813]: STATIC:
Nov 15 12:54:48 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408
Nov 15 12:54:48 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:54:48 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:54:48 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1
Nov 15 12:54:48 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:54:48 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:54:48 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62
Nov 15 12:54:48 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:54:48 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:54:48 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f
Nov 15 12:54:48 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:54:48 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:54:48 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:54:48 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:54:48 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:54:48 user nova-compute[75813]: FIRMWARE:
Nov 15 12:54:48 user nova-compute[75813]: No targets found.
Nov 15 12:54:48 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:54:48 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:54:48 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:54:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[df468d1a-c451-419c-bb02-6d234c52cf4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d35d6df-29af-489e-9c37-3b1bdf52b7ec]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:49 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:49 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:49 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:49 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:49 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:49 user nova-compute[75813]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f (non-flash)
Nov 15 12:54:49 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:49 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55502572e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f'): ({'sdd'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Removing single pathed devices sdd {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[97937ce8-e68e-4748-b600-1f26ad57939b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[572aaeff-9241-47c2-be1d-d9d18bcfab53]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Flushing IO for device /dev/sdd {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68bf879-cb18-4e8a-b540-e69f85ae7709]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdef317-468f-43f8-b09d-50ce4798c4fe]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cd185c-ca00-4328-85b3-ca36d97875b3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[788bc0c3-6173-4015-9178-c41d6e6854a5]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f, portal: 172.16.0.220,3260]
Nov 15 12:54:49 user nova-compute[75813]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f, portal: 172.16.0.220,3260] successful.
Nov 15 12:54:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a531f0af-18f9-474b-be87-2b70a4eda75f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[261d01db-98d8-41e8-bdd7-b6f9c502553d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== disconnect_volume: return (299ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.network.neutron [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updated VIF entry in instance network info cache for port b22b7864-5cdf-4a54-a11e-13cfa447176d. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.network.neutron [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating instance_info_cache with network_info: [{"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] Releasing lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-changed-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing instance network info cache due to event network-changed-c6ffea0d-cd4a-4764-90b8-6405da06ccf7. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] Acquiring lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] Acquired lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.network.neutron [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing network info cache for port c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:49 user nova-compute[75813]: INFO nova.virt.block_device [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Booting with volume 31960f1c-e93b-4e10-9fdc-97b28904c837 at /dev/vdc
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.utils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab86aea2-8665-46d6-9bac-a41ced0e5b00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.network.neutron [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updated VIF entry in instance network info cache for port c6ffea0d-cd4a-4764-90b8-6405da06ccf7. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.network.neutron [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating instance_info_cache with network_info: [{"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4fa305-cdb8-404b-af43-5f1564a2c937]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] Releasing lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-changed-d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing instance network info cache due to event network-changed-d124ff05-0b46-42a8-a684-db795f1fca12. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] Acquiring lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] Acquired lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.network.neutron [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing network info cache for port d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b8b8a0-e0a5-4ad3-9bdc-1e75d8c5974d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86faadd-a362-4af6-ac5a-bb5143a2bdcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:54:49 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:54:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3d94e6-0360-437e-9471-5aff1df23079]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG os_brick.utils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating existing volume attachment record: f063a2f7-4023-4944-ae67-860849538e84 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:54:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:50 user nova-compute[75813]: DEBUG nova.objects.instance [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5f68e1e8-fa92-4941-8d0c-01295acee571 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.912s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updated VIF entry in instance network info cache for port d124ff05-0b46-42a8-a684-db795f1fca12. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:54:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating instance_info_cache with network_info: [{"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:54:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f22fde12-6919-4259-91f2-75fecd6a27fa req-7d97b6de-b10e-4159-8677-abbd1e75de32 service nova] Releasing lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:54:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:54:54 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Creating image(s)
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Ensure instance console log exists: /opt/stack/data/nova/instances/794722de-e692-49f8-8bc9-ff64854ec405/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Start _get_guest_xml network_info=[{"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '50f20d56-780a-4097-aed1-c216a3214efc', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEoBgLUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '794722de-e692-49f8-8bc9-ff64854ec405', 'attached_at': '', 'detached_at': '', 'volume_id': '848ab383-3042-43de-9652-8073233fae09', 'serial': '848ab383-3042-43de-9652-8073233fae09'}, 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '303cfea0-6945-490a-9071-4603b447b0f9', 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWwrpnQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '794722de-e692-49f8-8bc9-ff64854ec405', 'attached_at': '', 'detached_at': '', 'volume_id': '75697ebd-3d5d-4bd1-aeaa-b8f07ed19606', 'serial': '75697ebd-3d5d-4bd1-aeaa-b8f07ed19606'}, 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'attachment_id': 'f063a2f7-4023-4944-ae67-860849538e84', 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NnbDqjBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '794722de-e692-49f8-8bc9-ff64854ec405', 'attached_at': '', 'detached_at': '', 'volume_id': '31960f1c-e93b-4e10-9fdc-97b28904c837', 'serial': '31960f1c-e93b-4e10-9fdc-97b28904c837'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:54:54 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:54:54 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEoBgLUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:54 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:54 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:54 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9ca78c-b04c-47e5-8680-ab36d2deea5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:54:54 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c7c325-f695-4fa0-98fe-35f95514b89a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09] added
Nov 15 12:54:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a21156-05b3-47c0-8fb6-386bfb5a0d9e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30ba5b5-9e5c-43f4-b03e-cbf78f5c6a9a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEoBgLUH {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEoBgLUH" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94a6a1a-64ef-4c66-abd7-7a42325563f8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JEoBgLUH'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b9f776-16c8-4849-9e09-9cdf3b1a28eb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[af097f16-a11a-4f03-9eb4-16824e203ac9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:54 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:54 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:54 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:54 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:54 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:54 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ad1e33-a2c8-49c2-b296-eb4a9ca3495e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09, portal: 172.16.0.220,3260]
Nov 15 12:54:55 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09, portal: 172.16.0.220,3260] successful.
Nov 15 12:54:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdff90b0-4beb-4e98-83b3-928f18ce438d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45c3a59-d615-48d3-98df-312673e8a815]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:55 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:55 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:55 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:55 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:55 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:55 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:55 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:55 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[017d06f0-f61f-4390-9e05-f8fa5c1368be]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEoBgLUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:54:55 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e is timed out.
Nov 15 12:54:55 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Successfully detached device vdb from instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e from the live domain config.
Nov 15 12:54:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUcrqBzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:55 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23439656366363831', 'path': '/dev/sdd'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439656366363831', 'path': '/dev/sdd'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.874s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWwrpnQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:56 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c45977a-9132-4415-8156-e5f749fe30ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:54:56 user nova-compute[75813]: No targets found.
Nov 15 12:54:56 user nova-compute[75813]: iSNS:
Nov 15 12:54:56 user nova-compute[75813]: No targets found.
Nov 15 12:54:56 user nova-compute[75813]: STATIC:
Nov 15 12:54:56 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408
Nov 15 12:54:56 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:54:56 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:54:56 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1
Nov 15 12:54:56 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:54:56 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:54:56 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62
Nov 15 12:54:56 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:54:56 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:54:56 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09
Nov 15 12:54:56 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:54:56 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:54:56 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:54:56 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:54:56 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:54:56 user nova-compute[75813]: FIRMWARE:
Nov 15 12:54:56 user nova-compute[75813]: No targets found.
Nov 15 12:54:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:54:56 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:54:56 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fbf212-3ab7-4bd7-9ecb-24ecc0ac4f58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[386db194-ec8c-4c37-a6dd-26e3c9a3eb6e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55306431c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408'): ({'sde'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Removing single pathed devices sde {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[713e9087-c2c0-4efd-80a9-dc3279cd3c39]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[024af22d-e93a-44e8-9a86-b2788a9e4105]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Flushing IO for device /dev/sde {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[346f79a1-7ea2-41b4-8604-9af651a23dbb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df937b4-7ca2-4452-a963-3b8b1423770c]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab13972-e7f9-4e5a-b7cc-e36bfcc6e526]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8773e737-61fc-4fc3-9964-357317caab1f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408, portal: 172.16.0.220,3260]
Nov 15 12:54:56 user nova-compute[75813]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408, portal: 172.16.0.220,3260] successful.
Nov 15 12:54:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f397238-fb52-46ac-b97c-c2a1933bc408 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd4d644-ecc6-47b8-aaf2-73e3a6d1e8a5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] <== disconnect_volume: return (1176ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.283s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:56 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:56 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[412511e5-c1ed-4264-9b8b-6b9cd451f815]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:54:56 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c5a2d5-03e1-4b39-8239-315002ff6399]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606] added
Nov 15 12:54:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a377a48-b6c5-4cb6-9f1d-b7394d46b17b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f80f5c0-a024-4730-8fc0-80852f0769e0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CWwrpnQP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CWwrpnQP" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbe440a-92e1-4294-be72-07604106f271]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CWwrpnQP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[114b51bc-df51-47c5-913a-212db6513594]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[35706803-deed-4a2c-8acf-09f6e2558d48]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ff00c9-a45f-4cb8-b3fc-9b1a3c7ae2aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606, portal: 172.16.0.220,3260]
Nov 15 12:54:56 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606, portal: 172.16.0.220,3260] successful.
Nov 15 12:54:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acd3bc8-57c5-46e3-afff-01c5905ecab5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcaa3c4-01b4-4189-ac76-093f09a4140b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:54:56 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0308e7f-2791-483c-befa-4dd599b0e349]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:56 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lazy-loading 'flavor' on Instance uuid 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3133b6a7-0aa6-40e5-8fba-08f25033624a tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.590s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWwrpnQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] <== connect_volume: return (1597ms) {'type': 'block', 'scsi_wwn': '26237653964383433', 'path': '/dev/sde'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237653964383433', 'path': '/dev/sde'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NnbDqjBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:54:57 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:57 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:54:57 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ecfa23-beae-4878-8537-442b81133201]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:54:57 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ecd174-c278-4097-851b-13f994aeaf34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837] added
Nov 15 12:54:57 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7050a9f8-8485-474c-ad57-5fe045e3b3db]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac96749b-6cc3-42c4-b0db-582aaea6faa0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NnbDqjBp {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NnbDqjBp" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d472d082-5fc5-4098-af9d-6567a7164573]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NnbDqjBp'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd461b9-fa2c-4117-9542-3381da287ba4]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f828e2e-c867-43b4-856d-771d68ebb27f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:57 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:57 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:57 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:57 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:54:57 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:57 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:57 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:57 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:57 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:54:57 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7978708-e55a-4c54-926f-22c6a27ddf31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837, portal: 172.16.0.220,3260]
Nov 15 12:54:58 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837, portal: 172.16.0.220,3260] successful.
Nov 15 12:54:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e0dd76-cfcb-49d9-bcee-059083da527a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f26aec-aff9-4f0f-ad5e-5d15d170b49a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:58 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:58 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:58 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:58 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:54:58 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:54:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:54:58 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:54:58 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:54:58 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:54:58 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:54:58 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:54:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ce3b5c-c798-429a-a925-ef7e277b2d15]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "interface-868f2db9-e52c-4f9a-8bd3-18ec6807377e-b46434a3-ad87-45e7-bbb1-a01ac2a871d7" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "interface-868f2db9-e52c-4f9a-8bd3-18ec6807377e-b46434a3-ad87-45e7-bbb1-a01ac2a871d7" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.objects.instance [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lazy-loading 'flavor' on Instance uuid 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211354557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211354557',id=15,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy1dLT3BMBPj0HMd2wO6SlIfeOmZ5zLbEAioS6Myt1UETKqLiMh/MFli0JtJDPjUkaSiV8utv6xgh1ZfE1PdfxOgyxPJzAm7dYkPDYpHgRwmjqP16hyPEVizDOZD284gw==',key_name='tempest-keypair-1348731404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce97b303bdb940c59d6cea5ad91ef0d4',ramdisk_id='',reservation_id='r-mq0pxr7o',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179121499',owner_user_name='tempest-TaggedAttachmentsTest-1179121499-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74615b8601894772b20328f7b894c9a1',uuid=868f2db9-e52c-4f9a-8bd3-18ec6807377e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converting VIF {"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:bb:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tapb46434a3-ad"/></interface> {{(pid=75813) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:bb:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tapb46434a3-ad"/></interface> {{(pid=75813) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Attempting to detach device tapb46434a3-ad from instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] detach device xml: <interface type="ethernet">
Nov 15 12:54:58 user nova-compute[75813]:   <mac address="fa:16:3e:05:bb:ea"/>
Nov 15 12:54:58 user nova-compute[75813]:   <model type="virtio"/>
Nov 15 12:54:58 user nova-compute[75813]:   <mtu size="1442"/>
Nov 15 12:54:58 user nova-compute[75813]:   <target dev="tapb46434a3-ad"/>
Nov 15 12:54:58 user nova-compute[75813]: </interface>
Nov 15 12:54:58 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:bb:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tapb46434a3-ad"/></interface> {{(pid=75813) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:05:bb:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tapb46434a3-ad"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 15 12:54:58 user nova-compute[75813]:   <name>instance-0000000f</name>
Nov 15 12:54:58 user nova-compute[75813]:   <uuid>868f2db9-e52c-4f9a-8bd3-18ec6807377e</uuid>
Nov 15 12:54:58 user nova-compute[75813]:   <metadata>
Nov 15 12:54:58 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:54:58 user nova-compute[75813]:   <nova:package version="0.0.0"/>
Nov 15 12:54:58 user nova-compute[75813]:   <nova:name>tempest-device-tagging-server-211354557</nova:name>
Nov 15 12:54:58 user nova-compute[75813]:   <nova:creationTime>2023-11-15 12:54:25</nova:creationTime>
Nov 15 12:54:58 user nova-compute[75813]:   <nova:flavor name="m1.tiny">
Nov 15 12:54:58 user nova-compute[75813]:     <nova:memory>512</nova:memory>
Nov 15 12:54:58 user nova-compute[75813]:     <nova:disk>1</nova:disk>
Nov 15 12:54:58 user nova-compute[75813]:     <nova:swap>0</nova:swap>
Nov 15 12:54:58 user nova-compute[75813]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:54:58 user nova-compute[75813]:     <nova:vcpus>1</nova:vcpus>
Nov 15 12:54:58 user nova-compute[75813]:   </nova:flavor>
Nov 15 12:54:58 user nova-compute[75813]:   <nova:owner>
Nov 15 12:54:58 user nova-compute[75813]:     <nova:user uuid="74615b8601894772b20328f7b894c9a1">tempest-TaggedAttachmentsTest-1179121499-project-member</nova:user>
Nov 15 12:54:58 user nova-compute[75813]:     <nova:project uuid="ce97b303bdb940c59d6cea5ad91ef0d4">tempest-TaggedAttachmentsTest-1179121499</nova:project>
Nov 15 12:54:58 user nova-compute[75813]:   </nova:owner>
Nov 15 12:54:58 user nova-compute[75813]:   <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:54:58 user nova-compute[75813]:   <nova:ports>
Nov 15 12:54:58 user nova-compute[75813]:     <nova:port uuid="637149a0-24b9-4fed-8cc4-6dd3a909c874">
Nov 15 12:54:58 user nova-compute[75813]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 12:54:58 user nova-compute[75813]:     </nova:port>
Nov 15 12:54:58 user nova-compute[75813]:     <nova:port uuid="b46434a3-ad87-45e7-bbb1-a01ac2a871d7">
Nov 15 12:54:58 user nova-compute[75813]:       <nova:ip type="fixed" address="10.10.10.25" ipVersion="4"/>
Nov 15 12:54:58 user nova-compute[75813]:     </nova:port>
Nov 15 12:54:58 user nova-compute[75813]:   </nova:ports>
Nov 15 12:54:58 user nova-compute[75813]: </nova:instance>
Nov 15 12:54:58 user nova-compute[75813]:   </metadata>
Nov 15 12:54:58 user nova-compute[75813]:   <memory unit='KiB'>524288</memory>
Nov 15 12:54:58 user nova-compute[75813]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 12:54:58 user nova-compute[75813]:   <vcpu placement='static'>1</vcpu>
Nov 15 12:54:58 user nova-compute[75813]:   <resource>
Nov 15 12:54:58 user nova-compute[75813]:     <partition>/machine</partition>
Nov 15 12:54:58 user nova-compute[75813]:   </resource>
Nov 15 12:54:58 user nova-compute[75813]:   <sysinfo type='smbios'>
Nov 15 12:54:58 user nova-compute[75813]:     <system>
Nov 15 12:54:58 user nova-compute[75813]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 12:54:58 user nova-compute[75813]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 12:54:58 user nova-compute[75813]:       <entry name='version'>0.0.0</entry>
Nov 15 12:54:58 user nova-compute[75813]:       <entry name='serial'>868f2db9-e52c-4f9a-8bd3-18ec6807377e</entry>
Nov 15 12:54:58 user nova-compute[75813]:       <entry name='uuid'>868f2db9-e52c-4f9a-8bd3-18ec6807377e</entry>
Nov 15 12:54:58 user nova-compute[75813]:       <entry name='family'>Virtual Machine</entry>
Nov 15 12:54:58 user nova-compute[75813]:     </system>
Nov 15 12:54:58 user nova-compute[75813]:   </sysinfo>
Nov 15 12:54:58 user nova-compute[75813]:   <os>
Nov 15 12:54:58 user nova-compute[75813]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 12:54:58 user nova-compute[75813]:     <boot dev='hd'/>
Nov 15 12:54:58 user nova-compute[75813]:     <smbios mode='sysinfo'/>
Nov 15 12:54:58 user nova-compute[75813]:   </os>
Nov 15 12:54:58 user nova-compute[75813]:   <features>
Nov 15 12:54:58 user nova-compute[75813]:     <acpi/>
Nov 15 12:54:58 user nova-compute[75813]:     <apic/>
Nov 15 12:54:58 user nova-compute[75813]:     <vmcoreinfo state='on'/>
Nov 15 12:54:58 user nova-compute[75813]:   </features>
Nov 15 12:54:58 user nova-compute[75813]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 12:54:58 user nova-compute[75813]:     <model fallback='forbid'>Nehalem</model>
Nov 15 12:54:58 user nova-compute[75813]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 12:54:58 user nova-compute[75813]:     <feature policy='require' name='vme'/>
Nov 15 12:54:58 user nova-compute[75813]:     <feature policy='require' name='x2apic'/>
Nov 15 12:54:58 user nova-compute[75813]:     <feature policy='require' name='hypervisor'/>
Nov 15 12:54:58 user nova-compute[75813]:   </cpu>
Nov 15 12:54:58 user nova-compute[75813]:   <clock offset='utc'>
Nov 15 12:54:58 user nova-compute[75813]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 12:54:58 user nova-compute[75813]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 12:54:58 user nova-compute[75813]:     <timer name='hpet' present='no'/>
Nov 15 12:54:58 user nova-compute[75813]:   </clock>
Nov 15 12:54:58 user nova-compute[75813]:   <on_poweroff>destroy</on_poweroff>
Nov 15 12:54:58 user nova-compute[75813]:   <on_reboot>restart</on_reboot>
Nov 15 12:54:58 user nova-compute[75813]:   <on_crash>destroy</on_crash>
Nov 15 12:54:58 user nova-compute[75813]:   <devices>
Nov 15 12:54:58 user nova-compute[75813]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 12:54:58 user nova-compute[75813]:     <disk type='file' device='disk'>
Nov 15 12:54:58 user nova-compute[75813]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 12:54:58 user nova-compute[75813]:       <source file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk' index='2'/>
Nov 15 12:54:58 user nova-compute[75813]:       <backingStore type='file' index='3'>
Nov 15 12:54:58 user nova-compute[75813]:         <format type='raw'/>
Nov 15 12:54:58 user nova-compute[75813]:         <source file='/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4'/>
Nov 15 12:54:58 user nova-compute[75813]:         <backingStore/>
Nov 15 12:54:58 user nova-compute[75813]:       </backingStore>
Nov 15 12:54:58 user nova-compute[75813]:       <target dev='vda' bus='virtio'/>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='virtio-disk0'/>
Nov 15 12:54:58 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </disk>
Nov 15 12:54:58 user nova-compute[75813]:     <disk type='file' device='cdrom'>
Nov 15 12:54:58 user nova-compute[75813]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 12:54:58 user nova-compute[75813]:       <source file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk.config' index='1'/>
Nov 15 12:54:58 user nova-compute[75813]:       <backingStore/>
Nov 15 12:54:58 user nova-compute[75813]:       <target dev='hda' bus='ide'/>
Nov 15 12:54:58 user nova-compute[75813]:       <readonly/>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='ide0-0-0'/>
Nov 15 12:54:58 user nova-compute[75813]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </disk>
Nov 15 12:54:58 user nova-compute[75813]:     <controller type='usb' index='0' model='none'>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='usb'/>
Nov 15 12:54:58 user nova-compute[75813]:     </controller>
Nov 15 12:54:58 user nova-compute[75813]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='pci.0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </controller>
Nov 15 12:54:58 user nova-compute[75813]:     <controller type='ide' index='0'>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='ide'/>
Nov 15 12:54:58 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 12:54:58 user nova-compute[75813]:     </controller>
Nov 15 12:54:58 user nova-compute[75813]:     <interface type='ethernet'>
Nov 15 12:54:58 user nova-compute[75813]:       <mac address='fa:16:3e:e0:6d:60'/>
Nov 15 12:54:58 user nova-compute[75813]:       <target dev='tap637149a0-24'/>
Nov 15 12:54:58 user nova-compute[75813]:       <model type='virtio'/>
Nov 15 12:54:58 user nova-compute[75813]:       <mtu size='1442'/>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='net0'/>
Nov 15 12:54:58 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </interface>
Nov 15 12:54:58 user nova-compute[75813]:     <interface type='ethernet'>
Nov 15 12:54:58 user nova-compute[75813]:       <mac address='fa:16:3e:05:bb:ea'/>
Nov 15 12:54:58 user nova-compute[75813]:       <target dev='tapb46434a3-ad'/>
Nov 15 12:54:58 user nova-compute[75813]:       <model type='virtio'/>
Nov 15 12:54:58 user nova-compute[75813]:       <mtu size='1442'/>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='net1'/>
Nov 15 12:54:58 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </interface>
Nov 15 12:54:58 user nova-compute[75813]:     <serial type='pty'>
Nov 15 12:54:58 user nova-compute[75813]:       <source path='/dev/pts/6'/>
Nov 15 12:54:58 user nova-compute[75813]:       <log file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/console.log' append='off'/>
Nov 15 12:54:58 user nova-compute[75813]:       <target type='isa-serial' port='0'>
Nov 15 12:54:58 user nova-compute[75813]:         <model name='isa-serial'/>
Nov 15 12:54:58 user nova-compute[75813]:       </target>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='serial0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </serial>
Nov 15 12:54:58 user nova-compute[75813]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 12:54:58 user nova-compute[75813]:       <source path='/dev/pts/6'/>
Nov 15 12:54:58 user nova-compute[75813]:       <log file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/console.log' append='off'/>
Nov 15 12:54:58 user nova-compute[75813]:       <target type='serial' port='0'/>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='serial0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </console>
Nov 15 12:54:58 user nova-compute[75813]:     <input type='mouse' bus='ps2'>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='input0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </input>
Nov 15 12:54:58 user nova-compute[75813]:     <input type='keyboard' bus='ps2'>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='input1'/>
Nov 15 12:54:58 user nova-compute[75813]:     </input>
Nov 15 12:54:58 user nova-compute[75813]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 12:54:58 user nova-compute[75813]:       <listen type='address' address='0.0.0.0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </graphics>
Nov 15 12:54:58 user nova-compute[75813]:     <audio id='1' type='none'/>
Nov 15 12:54:58 user nova-compute[75813]:     <video>
Nov 15 12:54:58 user nova-compute[75813]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='video0'/>
Nov 15 12:54:58 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </video>
Nov 15 12:54:58 user nova-compute[75813]:     <memballoon model='virtio'>
Nov 15 12:54:58 user nova-compute[75813]:       <stats period='10'/>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='balloon0'/>
Nov 15 12:54:58 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </memballoon>
Nov 15 12:54:58 user nova-compute[75813]:     <rng model='virtio'>
Nov 15 12:54:58 user nova-compute[75813]:       <backend model='random'>/dev/urandom</backend>
Nov 15 12:54:58 user nova-compute[75813]:       <alias name='rng0'/>
Nov 15 12:54:58 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 12:54:58 user nova-compute[75813]:     </rng>
Nov 15 12:54:58 user nova-compute[75813]:   </devices>
Nov 15 12:54:58 user nova-compute[75813]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 12:54:58 user nova-compute[75813]:     <label>libvirt-868f2db9-e52c-4f9a-8bd3-18ec6807377e</label>
Nov 15 12:54:58 user nova-compute[75813]:     <imagelabel>libvirt-868f2db9-e52c-4f9a-8bd3-18ec6807377e</imagelabel>
Nov 15 12:54:58 user nova-compute[75813]:   </seclabel>
Nov 15 12:54:58 user nova-compute[75813]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 12:54:58 user nova-compute[75813]:     <label>+64055:+108</label>
Nov 15 12:54:58 user nova-compute[75813]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 12:54:58 user nova-compute[75813]:   </seclabel>
Nov 15 12:54:58 user nova-compute[75813]: </domain>
Nov 15 12:54:58 user nova-compute[75813]:  {{(pid=75813) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 12:54:58 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Successfully detached device tapb46434a3-ad from instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e from the persistent domain config.
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] (1/8): Attempting to detach device tapb46434a3-ad with device alias net1 from instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] detach device xml: <interface type="ethernet">
Nov 15 12:54:58 user nova-compute[75813]:   <mac address="fa:16:3e:05:bb:ea"/>
Nov 15 12:54:58 user nova-compute[75813]:   <model type="virtio"/>
Nov 15 12:54:58 user nova-compute[75813]:   <mtu size="1442"/>
Nov 15 12:54:58 user nova-compute[75813]:   <target dev="tapb46434a3-ad"/>
Nov 15 12:54:58 user nova-compute[75813]: </interface>
Nov 15 12:54:58 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Start waiting for the detach event from libvirt for device tapb46434a3-ad with device alias net1 for instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-1896460e-462e-4cde-abe4-f7f11b7e188e req-eec30ac6-b6a9-4051-89e9-d2f706e66076 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-vif-unplugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1896460e-462e-4cde-abe4-f7f11b7e188e req-eec30ac6-b6a9-4051-89e9-d2f706e66076 service nova] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1896460e-462e-4cde-abe4-f7f11b7e188e req-eec30ac6-b6a9-4051-89e9-d2f706e66076 service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1896460e-462e-4cde-abe4-f7f11b7e188e req-eec30ac6-b6a9-4051-89e9-d2f706e66076 service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:54:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-1896460e-462e-4cde-abe4-f7f11b7e188e req-eec30ac6-b6a9-4051-89e9-d2f706e66076 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] No waiting events found dispatching network-vif-unplugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:54:58 user nova-compute[75813]: WARNING nova.compute.manager [req-1896460e-462e-4cde-abe4-f7f11b7e188e req-eec30ac6-b6a9-4051-89e9-d2f706e66076 service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received unexpected event network-vif-unplugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 for instance with vm_state active and task_state None.
Nov 15 12:54:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NnbDqjBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23337633461643162', 'path': '/dev/sdg'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337633461643162', 'path': '/dev/sdg'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:fd:5c,bridge_name='br-int',has_traffic_filtering=True,id=343ad4aa-1f1e-4a58-88fa-d9ec606277e6,network=Network(22d0cdff-a461-41d6-9729-02e3ca3d8e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343ad4aa-1f') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:21:72,bridge_name='br-int',has_traffic_filtering=True,id=c283df15-5363-4933-b3c1-95201604f7b2,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc283df15-53') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:11:fe,bridge_name='br-int',has_traffic_filtering=True,id=c1044bb7-bc9d-4730-b0e4-fd2b50fece18,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1044bb7-bc') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e9:d6,bridge_name='br-int',has_traffic_filtering=True,id=2bdba87c-b645-4d17-9470-a5c9d8b7341e,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdba87c-b6') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:95:62,bridge_name='br-int',has_traffic_filtering=True,id=b22b7864-5cdf-4a54-a11e-13cfa447176d,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b7864-5c') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:41:fe,bridge_name='br-int',has_traffic_filtering=True,id=c6ffea0d-cd4a-4764-90b8-6405da06ccf7,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6ffea0d-cd') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:42:58,bridge_name='br-int',has_traffic_filtering=True,id=d124ff05-0b46-42a8-a684-db795f1fca12,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd124ff05-0b') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.objects.instance [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lazy-loading 'pci_devices' on Instance uuid 794722de-e692-49f8-8bc9-ff64854ec405 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:54:59 user nova-compute[75813]:   <uuid>794722de-e692-49f8-8bc9-ff64854ec405</uuid>
Nov 15 12:54:59 user nova-compute[75813]:   <name>instance-00000012</name>
Nov 15 12:54:59 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:54:59 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:54:59 user nova-compute[75813]:   <metadata>
Nov 15 12:54:59 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:54:59 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:54:59 user nova-compute[75813]:       <nova:name>tempest-device-tagging-server-1249190170</nova:name>
Nov 15 12:54:59 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:54:54</nova:creationTime>
Nov 15 12:54:59 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:54:59 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:54:59 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:54:59 user nova-compute[75813]:       <nova:owner>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:user uuid="e544761c815a47c2b414141e839dee47">tempest-TaggedBootDevicesTest_v242-451109879-project-member</nova:user>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:project uuid="baca56dbe0004f82b45bd165781ff06f">tempest-TaggedBootDevicesTest_v242-451109879</nova:project>
Nov 15 12:54:59 user nova-compute[75813]:       </nova:owner>
Nov 15 12:54:59 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:54:59 user nova-compute[75813]:       <nova:ports>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:port uuid="343ad4aa-1f1e-4a58-88fa-d9ec606277e6">
Nov 15 12:54:59 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 12:54:59 user nova-compute[75813]:         </nova:port>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:port uuid="c283df15-5363-4933-b3c1-95201604f7b2">
Nov 15 12:54:59 user nova-compute[75813]:           <nova:ip type="fixed" address="10.1.1.238" ipVersion="4"/>
Nov 15 12:54:59 user nova-compute[75813]:         </nova:port>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:port uuid="c1044bb7-bc9d-4730-b0e4-fd2b50fece18">
Nov 15 12:54:59 user nova-compute[75813]:           <nova:ip type="fixed" address="10.1.1.215" ipVersion="4"/>
Nov 15 12:54:59 user nova-compute[75813]:         </nova:port>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:port uuid="2bdba87c-b645-4d17-9470-a5c9d8b7341e">
Nov 15 12:54:59 user nova-compute[75813]:           <nova:ip type="fixed" address="10.1.1.201" ipVersion="4"/>
Nov 15 12:54:59 user nova-compute[75813]:         </nova:port>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:port uuid="b22b7864-5cdf-4a54-a11e-13cfa447176d">
Nov 15 12:54:59 user nova-compute[75813]:           <nova:ip type="fixed" address="10.1.1.216" ipVersion="4"/>
Nov 15 12:54:59 user nova-compute[75813]:         </nova:port>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:port uuid="c6ffea0d-cd4a-4764-90b8-6405da06ccf7">
Nov 15 12:54:59 user nova-compute[75813]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 12:54:59 user nova-compute[75813]:         </nova:port>
Nov 15 12:54:59 user nova-compute[75813]:         <nova:port uuid="d124ff05-0b46-42a8-a684-db795f1fca12">
Nov 15 12:54:59 user nova-compute[75813]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 12:54:59 user nova-compute[75813]:         </nova:port>
Nov 15 12:54:59 user nova-compute[75813]:       </nova:ports>
Nov 15 12:54:59 user nova-compute[75813]:     </nova:instance>
Nov 15 12:54:59 user nova-compute[75813]:   </metadata>
Nov 15 12:54:59 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:54:59 user nova-compute[75813]:     <system>
Nov 15 12:54:59 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:54:59 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:54:59 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:54:59 user nova-compute[75813]:       <entry name="serial">794722de-e692-49f8-8bc9-ff64854ec405</entry>
Nov 15 12:54:59 user nova-compute[75813]:       <entry name="uuid">794722de-e692-49f8-8bc9-ff64854ec405</entry>
Nov 15 12:54:59 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:54:59 user nova-compute[75813]:     </system>
Nov 15 12:54:59 user nova-compute[75813]:   </sysinfo>
Nov 15 12:54:59 user nova-compute[75813]:   <os>
Nov 15 12:54:59 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:54:59 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:54:59 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:54:59 user nova-compute[75813]:   </os>
Nov 15 12:54:59 user nova-compute[75813]:   <features>
Nov 15 12:54:59 user nova-compute[75813]:     <acpi/>
Nov 15 12:54:59 user nova-compute[75813]:     <apic/>
Nov 15 12:54:59 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:54:59 user nova-compute[75813]:   </features>
Nov 15 12:54:59 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:54:59 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:54:59 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:54:59 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:54:59 user nova-compute[75813]:   </clock>
Nov 15 12:54:59 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:54:59 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:54:59 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:54:59 user nova-compute[75813]:   </cpu>
Nov 15 12:54:59 user nova-compute[75813]:   <devices>
Nov 15 12:54:59 user nova-compute[75813]:     <disk type="file" device="cdrom">
Nov 15 12:54:59 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 12:54:59 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/794722de-e692-49f8-8bc9-ff64854ec405/disk.config"/>
Nov 15 12:54:59 user nova-compute[75813]:       <target dev="hda" bus="ide"/>
Nov 15 12:54:59 user nova-compute[75813]:     </disk>
Nov 15 12:54:59 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 12:54:59 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:59 user nova-compute[75813]:       <source dev="/dev/sdd"/>
Nov 15 12:54:59 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:54:59 user nova-compute[75813]:       <serial>848ab383-3042-43de-9652-8073233fae09</serial>
Nov 15 12:54:59 user nova-compute[75813]:     </disk>
Nov 15 12:54:59 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 12:54:59 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:59 user nova-compute[75813]:       <source dev="/dev/sde"/>
Nov 15 12:54:59 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 12:54:59 user nova-compute[75813]:       <serial>75697ebd-3d5d-4bd1-aeaa-b8f07ed19606</serial>
Nov 15 12:54:59 user nova-compute[75813]:     </disk>
Nov 15 12:54:59 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 12:54:59 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:54:59 user nova-compute[75813]:       <source dev="/dev/sdg"/>
Nov 15 12:54:59 user nova-compute[75813]:       <target dev="vdc" bus="virtio"/>
Nov 15 12:54:59 user nova-compute[75813]:       <serial>31960f1c-e93b-4e10-9fdc-97b28904c837</serial>
Nov 15 12:54:59 user nova-compute[75813]:     </disk>
Nov 15 12:54:59 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:54:59 user nova-compute[75813]:       <mac address="fa:16:3e:18:fd:5c"/>
Nov 15 12:54:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:59 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:54:59 user nova-compute[75813]:       <target dev="tap343ad4aa-1f"/>
Nov 15 12:54:59 user nova-compute[75813]:     </interface>
Nov 15 12:54:59 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:54:59 user nova-compute[75813]:       <mac address="fa:16:3e:5b:21:72"/>
Nov 15 12:54:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:59 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:54:59 user nova-compute[75813]:       <target dev="tapc283df15-53"/>
Nov 15 12:54:59 user nova-compute[75813]:     </interface>
Nov 15 12:54:59 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:54:59 user nova-compute[75813]:       <mac address="fa:16:3e:67:11:fe"/>
Nov 15 12:54:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:59 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:54:59 user nova-compute[75813]:       <target dev="tapc1044bb7-bc"/>
Nov 15 12:54:59 user nova-compute[75813]:     </interface>
Nov 15 12:54:59 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:54:59 user nova-compute[75813]:       <mac address="fa:16:3e:3c:e9:d6"/>
Nov 15 12:54:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:59 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:54:59 user nova-compute[75813]:       <target dev="tap2bdba87c-b6"/>
Nov 15 12:54:59 user nova-compute[75813]:     </interface>
Nov 15 12:54:59 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:54:59 user nova-compute[75813]:       <mac address="fa:16:3e:ed:95:62"/>
Nov 15 12:54:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:59 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:54:59 user nova-compute[75813]:       <target dev="tapb22b7864-5c"/>
Nov 15 12:54:59 user nova-compute[75813]:     </interface>
Nov 15 12:54:59 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:54:59 user nova-compute[75813]:       <mac address="fa:16:3e:12:41:fe"/>
Nov 15 12:54:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:59 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:54:59 user nova-compute[75813]:       <target dev="tapc6ffea0d-cd"/>
Nov 15 12:54:59 user nova-compute[75813]:     </interface>
Nov 15 12:54:59 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:54:59 user nova-compute[75813]:       <mac address="fa:16:3e:10:42:58"/>
Nov 15 12:54:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:59 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:54:59 user nova-compute[75813]:       <target dev="tapd124ff05-0b"/>
Nov 15 12:54:59 user nova-compute[75813]:     </interface>
Nov 15 12:54:59 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:54:59 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/794722de-e692-49f8-8bc9-ff64854ec405/console.log" append="off"/>
Nov 15 12:54:59 user nova-compute[75813]:     </serial>
Nov 15 12:54:59 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:54:59 user nova-compute[75813]:     <video>
Nov 15 12:54:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:54:59 user nova-compute[75813]:     </video>
Nov 15 12:54:59 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:54:59 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:54:59 user nova-compute[75813]:     </rng>
Nov 15 12:54:59 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:54:59 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:54:59 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:54:59 user nova-compute[75813]:     </memballoon>
Nov 15 12:54:59 user nova-compute[75813]:   </devices>
Nov 15 12:54:59 user nova-compute[75813]: </domain>
Nov 15 12:54:59 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:fd:5c,bridge_name='br-int',has_traffic_filtering=True,id=343ad4aa-1f1e-4a58-88fa-d9ec606277e6,network=Network(22d0cdff-a461-41d6-9729-02e3ca3d8e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343ad4aa-1f') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:fd:5c,bridge_name='br-int',has_traffic_filtering=True,id=343ad4aa-1f1e-4a58-88fa-d9ec606277e6,network=Network(22d0cdff-a461-41d6-9729-02e3ca3d8e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343ad4aa-1f') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '705cc474-1704-50a8-acf6-3d553cae0e0a', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap343ad4aa-1f, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap343ad4aa-1f, col_values=(('qos', UUID('ce253a44-a20d-4d83-8675-840a49d1dcdd')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap343ad4aa-1f, col_values=(('external_ids', {'iface-id': '343ad4aa-1f1e-4a58-88fa-d9ec606277e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:fd:5c', 'vm-uuid': '794722de-e692-49f8-8bc9-ff64854ec405'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: INFO os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:fd:5c,bridge_name='br-int',has_traffic_filtering=True,id=343ad4aa-1f1e-4a58-88fa-d9ec606277e6,network=Network(22d0cdff-a461-41d6-9729-02e3ca3d8e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343ad4aa-1f')
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:21:72,bridge_name='br-int',has_traffic_filtering=True,id=c283df15-5363-4933-b3c1-95201604f7b2,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc283df15-53') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:21:72,bridge_name='br-int',has_traffic_filtering=True,id=c283df15-5363-4933-b3c1-95201604f7b2,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc283df15-53') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe752532-7ace-56fd-ad2f-b2857b136a6d', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc283df15-53, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc283df15-53, col_values=(('qos', UUID('c816ce70-fbb1-421e-9044-f865f2c246c4')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc283df15-53, col_values=(('external_ids', {'iface-id': 'c283df15-5363-4933-b3c1-95201604f7b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:21:72', 'vm-uuid': '794722de-e692-49f8-8bc9-ff64854ec405'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: INFO os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:21:72,bridge_name='br-int',has_traffic_filtering=True,id=c283df15-5363-4933-b3c1-95201604f7b2,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc283df15-53')
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:11:fe,bridge_name='br-int',has_traffic_filtering=True,id=c1044bb7-bc9d-4730-b0e4-fd2b50fece18,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1044bb7-bc') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:11:fe,bridge_name='br-int',has_traffic_filtering=True,id=c1044bb7-bc9d-4730-b0e4-fd2b50fece18,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1044bb7-bc') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01d43239-ee0d-5016-b81f-35ce1c885e3c', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1044bb7-bc, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1044bb7-bc, col_values=(('qos', UUID('632b97e3-f6c8-4828-ad0e-8b39704b9ed5')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1044bb7-bc, col_values=(('external_ids', {'iface-id': 'c1044bb7-bc9d-4730-b0e4-fd2b50fece18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:11:fe', 'vm-uuid': '794722de-e692-49f8-8bc9-ff64854ec405'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: INFO os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:11:fe,bridge_name='br-int',has_traffic_filtering=True,id=c1044bb7-bc9d-4730-b0e4-fd2b50fece18,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1044bb7-bc')
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e9:d6,bridge_name='br-int',has_traffic_filtering=True,id=2bdba87c-b645-4d17-9470-a5c9d8b7341e,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdba87c-b6') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e9:d6,bridge_name='br-int',has_traffic_filtering=True,id=2bdba87c-b645-4d17-9470-a5c9d8b7341e,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdba87c-b6') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80683328-db1b-5278-8226-27be31d3152d', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bdba87c-b6, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bdba87c-b6, col_values=(('qos', UUID('548875e4-a993-4321-b099-f54db71fe524')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bdba87c-b6, col_values=(('external_ids', {'iface-id': '2bdba87c-b645-4d17-9470-a5c9d8b7341e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:e9:d6', 'vm-uuid': '794722de-e692-49f8-8bc9-ff64854ec405'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: INFO os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e9:d6,bridge_name='br-int',has_traffic_filtering=True,id=2bdba87c-b645-4d17-9470-a5c9d8b7341e,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdba87c-b6')
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:95:62,bridge_name='br-int',has_traffic_filtering=True,id=b22b7864-5cdf-4a54-a11e-13cfa447176d,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b7864-5c') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:95:62,bridge_name='br-int',has_traffic_filtering=True,id=b22b7864-5cdf-4a54-a11e-13cfa447176d,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b7864-5c') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bf22fa8-e55a-5c4a-b4d6-efdc8edd1419', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb22b7864-5c, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb22b7864-5c, col_values=(('qos', UUID('09250c74-2e3e-49ac-8fce-24e111c4b1fd')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb22b7864-5c, col_values=(('external_ids', {'iface-id': 'b22b7864-5cdf-4a54-a11e-13cfa447176d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:95:62', 'vm-uuid': '794722de-e692-49f8-8bc9-ff64854ec405'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: INFO os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:95:62,bridge_name='br-int',has_traffic_filtering=True,id=b22b7864-5cdf-4a54-a11e-13cfa447176d,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b7864-5c')
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:41:fe,bridge_name='br-int',has_traffic_filtering=True,id=c6ffea0d-cd4a-4764-90b8-6405da06ccf7,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6ffea0d-cd') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:41:fe,bridge_name='br-int',has_traffic_filtering=True,id=c6ffea0d-cd4a-4764-90b8-6405da06ccf7,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6ffea0d-cd') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f6b6643-db63-5de4-9241-3021507d99a1', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6ffea0d-cd, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6ffea0d-cd, col_values=(('qos', UUID('48b374bd-2680-41ec-97a6-6eef8336d28c')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6ffea0d-cd, col_values=(('external_ids', {'iface-id': 'c6ffea0d-cd4a-4764-90b8-6405da06ccf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:41:fe', 'vm-uuid': '794722de-e692-49f8-8bc9-ff64854ec405'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: INFO os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:41:fe,bridge_name='br-int',has_traffic_filtering=True,id=c6ffea0d-cd4a-4764-90b8-6405da06ccf7,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6ffea0d-cd')
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:42:58,bridge_name='br-int',has_traffic_filtering=True,id=d124ff05-0b46-42a8-a684-db795f1fca12,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd124ff05-0b') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:42:58,bridge_name='br-int',has_traffic_filtering=True,id=d124ff05-0b46-42a8-a684-db795f1fca12,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd124ff05-0b') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07beef6e-b83d-5fa3-9677-f6a799826d06', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd124ff05-0b, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd124ff05-0b, col_values=(('qos', UUID('5bfd52d7-a213-4b1a-b37e-adec3ee7bdfb')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd124ff05-0b, col_values=(('external_ids', {'iface-id': 'd124ff05-0b46-42a8-a684-db795f1fca12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:42:58', 'vm-uuid': '794722de-e692-49f8-8bc9-ff64854ec405'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:54:59 user nova-compute[75813]: INFO os_vif [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:42:58,bridge_name='br-int',has_traffic_filtering=True,id=d124ff05-0b46-42a8-a684-db795f1fca12,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd124ff05-0b')
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] No BDM found with device name hda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] No VIF found with MAC fa:16:3e:18:fd:5c, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:54:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] No VIF found with MAC fa:16:3e:ed:95:62, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:54:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Using config drive
Nov 15 12:55:00 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Creating config drive at /opt/stack/data/nova/instances/794722de-e692-49f8-8bc9-ff64854ec405/disk.config
Nov 15 12:55:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/794722de-e692-49f8-8bc9-ff64854ec405/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd67t8cxc {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/794722de-e692-49f8-8bc9-ff64854ec405/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd67t8cxc" returned: 0 in 0.055s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:00 user nova-compute[75813]: DEBUG nova.compute.manager [req-be877ed3-4fdd-4fe8-bf76-c75820688570 req-26f23487-2699-4aa4-8132-22fcb91c457f service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-vif-plugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-be877ed3-4fdd-4fe8-bf76-c75820688570 req-26f23487-2699-4aa4-8132-22fcb91c457f service nova] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-be877ed3-4fdd-4fe8-bf76-c75820688570 req-26f23487-2699-4aa4-8132-22fcb91c457f service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-be877ed3-4fdd-4fe8-bf76-c75820688570 req-26f23487-2699-4aa4-8132-22fcb91c457f service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:00 user nova-compute[75813]: DEBUG nova.compute.manager [req-be877ed3-4fdd-4fe8-bf76-c75820688570 req-26f23487-2699-4aa4-8132-22fcb91c457f service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] No waiting events found dispatching network-vif-plugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:00 user nova-compute[75813]: WARNING nova.compute.manager [req-be877ed3-4fdd-4fe8-bf76-c75820688570 req-26f23487-2699-4aa4-8132-22fcb91c457f service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received unexpected event network-vif-plugged-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 for instance with vm_state active and task_state None.
Nov 15 12:55:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-f922208e-bca2-4062-b1cb-3bc57444510d req-f15bfe13-a5e8-4199-801c-6af54481c51e service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f922208e-bca2-4062-b1cb-3bc57444510d req-f15bfe13-a5e8-4199-801c-6af54481c51e service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f922208e-bca2-4062-b1cb-3bc57444510d req-f15bfe13-a5e8-4199-801c-6af54481c51e service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f922208e-bca2-4062-b1cb-3bc57444510d req-f15bfe13-a5e8-4199-801c-6af54481c51e service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-f922208e-bca2-4062-b1cb-3bc57444510d req-f15bfe13-a5e8-4199-801c-6af54481c51e service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:01 user nova-compute[75813]: WARNING nova.compute.manager [req-f922208e-bca2-4062-b1cb-3bc57444510d req-f15bfe13-a5e8-4199-801c-6af54481c51e service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 for instance with vm_state building and task_state spawning.
Nov 15 12:55:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-af87f112-bc63-4143-9282-51e355257e20 req-bb230052-1d65-4b02-84d7-c27ad784a9d9 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-c283df15-5363-4933-b3c1-95201604f7b2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-af87f112-bc63-4143-9282-51e355257e20 req-bb230052-1d65-4b02-84d7-c27ad784a9d9 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-af87f112-bc63-4143-9282-51e355257e20 req-bb230052-1d65-4b02-84d7-c27ad784a9d9 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-af87f112-bc63-4143-9282-51e355257e20 req-bb230052-1d65-4b02-84d7-c27ad784a9d9 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-af87f112-bc63-4143-9282-51e355257e20 req-bb230052-1d65-4b02-84d7-c27ad784a9d9 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-c283df15-5363-4933-b3c1-95201604f7b2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:02 user nova-compute[75813]: WARNING nova.compute.manager [req-af87f112-bc63-4143-9282-51e355257e20 req-bb230052-1d65-4b02-84d7-c27ad784a9d9 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-c283df15-5363-4933-b3c1-95201604f7b2 for instance with vm_state building and task_state spawning.
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:02 user nova-compute[75813]: WARNING nova.compute.manager [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 for instance with vm_state building and task_state spawning.
Nov 15 12:55:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:02 user nova-compute[75813]: WARNING nova.compute.manager [req-aec6d024-38b2-4696-995a-d3186311bd35 req-73396922-e334-4ba5-8f7f-99c73519b386 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 for instance with vm_state building and task_state spawning.
Nov 15 12:55:02 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa is timed out.
Nov 15 12:55:02 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Successfully detached device vdb from instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa from the live domain config.
Nov 15 12:55:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htCjqHai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:55:02 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55a450c-eff0-4bf9-a88b-616114dfbb29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:55:02 user nova-compute[75813]: No targets found.
Nov 15 12:55:02 user nova-compute[75813]: iSNS:
Nov 15 12:55:02 user nova-compute[75813]: No targets found.
Nov 15 12:55:02 user nova-compute[75813]: STATIC:
Nov 15 12:55:02 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837
Nov 15 12:55:02 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:02 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:02 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1
Nov 15 12:55:02 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:02 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:02 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62
Nov 15 12:55:02 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:02 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:02 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09
Nov 15 12:55:02 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:02 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:02 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:55:02 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:02 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:02 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606
Nov 15 12:55:02 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:02 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:02 user nova-compute[75813]: FIRMWARE:
Nov 15 12:55:02 user nova-compute[75813]: No targets found.
Nov 15 12:55:02 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:55:02 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:55:02 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[484d4803-7895-42c4-8b2e-607df017494e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[34960116-89e5-4341-8e2d-2c7f234e8ae0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:55:02 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:55:02 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:55:02 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:55:02 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:55:02 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:55:02 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:55:02 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:55:02 user nova-compute[75813]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 (non-flash)
Nov 15 12:55:02 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:55:02 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:55:02 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:55:02 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55305829e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1'): ({'sdf'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Removing single pathed devices sdf {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06a801f-869d-414f-8295-a361cf1da72b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e67605b-9e4c-41c9-b3ab-4da8a37250bd]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Flushing IO for device /dev/sdf {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9251db93-dab6-432d-a4db-a49d75b8eaaf]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84b2bbf-b9a7-4b3e-8250-14e26a1c17be]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:55:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaf557f-9f62-4db3-a95f-e405b4f36669]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59d773b-49e0-4595-97b5-ec15ef59f3b2]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1, portal: 172.16.0.220,3260]
Nov 15 12:55:03 user nova-compute[75813]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1, portal: 172.16.0.220,3260] successful.
Nov 15 12:55:03 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40207771-5d0d-4e6d-9cf8-e2bf8d43aae1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69006df-1604-42d6-8ca6-10fd1531bc45]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] <== disconnect_volume: return (353ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:03 user nova-compute[75813]: WARNING nova.compute.manager [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 for instance with vm_state building and task_state spawning.
Nov 15 12:55:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:03 user nova-compute[75813]: WARNING nova.compute.manager [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 for instance with vm_state building and task_state spawning.
Nov 15 12:55:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:03 user nova-compute[75813]: WARNING nova.compute.manager [req-7e2b51e0-da78-454a-a745-2dc68ffcc1ef req-b1351113-6fa7-4ae9-a0ea-cd5ec7a7bb82 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 for instance with vm_state building and task_state spawning.
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.objects.instance [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lazy-loading 'flavor' on Instance uuid 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fbb56bda-9fef-44a8-af75-99dbd174ac34 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.865s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-c283df15-5363-4933-b3c1-95201604f7b2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-c283df15-5363-4933-b3c1-95201604f7b2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:04 user nova-compute[75813]: WARNING nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-c283df15-5363-4933-b3c1-95201604f7b2 for instance with vm_state building and task_state spawning.
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:04 user nova-compute[75813]: WARNING nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e for instance with vm_state building and task_state spawning.
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:04 user nova-compute[75813]: WARNING nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e for instance with vm_state building and task_state spawning.
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:04 user nova-compute[75813]: WARNING nova.compute.manager [req-06524b3f-0555-4f66-83f2-6a1503bdf767 req-ec9f1f0d-3545-412e-abe8-7b5f50c27941 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-d124ff05-0b46-42a8-a684-db795f1fca12 for instance with vm_state building and task_state spawning.
Nov 15 12:55:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:04 user nova-compute[75813]: WARNING nova.compute.manager [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-b22b7864-5cdf-4a54-a11e-13cfa447176d for instance with vm_state building and task_state spawning.
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:04 user nova-compute[75813]: WARNING nova.compute.manager [req-90d4f552-bfbb-4e6f-98cf-dc8b449a5772 req-7e0bd677-47ef-4dee-aff6-e636b4cb7b25 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-b22b7864-5cdf-4a54-a11e-13cfa447176d for instance with vm_state building and task_state spawning.
Nov 15 12:55:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:55:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:55:05 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Instance spawned successfully.
Nov 15 12:55:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:55:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:05 user nova-compute[75813]: INFO nova.compute.manager [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Took 10.92 seconds to spawn the instance on the hypervisor.
Nov 15 12:55:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:55:05 user nova-compute[75813]: INFO nova.compute.manager [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Took 27.38 seconds to build instance.
Nov 15 12:55:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f7097520-24e4-4dca-a6ad-179d540144a3 tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "794722de-e692-49f8-8bc9-ff64854ec405" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.474s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:06 user nova-compute[75813]: DEBUG nova.compute.manager [req-7c604747-4d6c-47c1-90ae-3f1880c292a6 req-2400875d-1af5-4e93-b9ce-b05ec567c958 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7c604747-4d6c-47c1-90ae-3f1880c292a6 req-2400875d-1af5-4e93-b9ce-b05ec567c958 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7c604747-4d6c-47c1-90ae-3f1880c292a6 req-2400875d-1af5-4e93-b9ce-b05ec567c958 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7c604747-4d6c-47c1-90ae-3f1880c292a6 req-2400875d-1af5-4e93-b9ce-b05ec567c958 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:06 user nova-compute[75813]: DEBUG nova.compute.manager [req-7c604747-4d6c-47c1-90ae-3f1880c292a6 req-2400875d-1af5-4e93-b9ce-b05ec567c958 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:06 user nova-compute[75813]: WARNING nova.compute.manager [req-7c604747-4d6c-47c1-90ae-3f1880c292a6 req-2400875d-1af5-4e93-b9ce-b05ec567c958 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-d124ff05-0b46-42a8-a684-db795f1fca12 for instance with vm_state active and task_state None.
Nov 15 12:55:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:18 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Waiting for libvirt event about the detach of device tapb46434a3-ad with device alias net1 from instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e is timed out.
Nov 15 12:55:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:bb:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tapb46434a3-ad"/></interface> {{(pid=75813) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:05:bb:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tapb46434a3-ad"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 15 12:55:18 user nova-compute[75813]:   <name>instance-0000000f</name>
Nov 15 12:55:18 user nova-compute[75813]:   <uuid>868f2db9-e52c-4f9a-8bd3-18ec6807377e</uuid>
Nov 15 12:55:18 user nova-compute[75813]:   <metadata>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:55:18 user nova-compute[75813]:   <nova:package version="0.0.0"/>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:name>tempest-device-tagging-server-211354557</nova:name>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:creationTime>2023-11-15 12:54:25</nova:creationTime>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:flavor name="m1.tiny">
Nov 15 12:55:18 user nova-compute[75813]:     <nova:memory>512</nova:memory>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:disk>1</nova:disk>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:swap>0</nova:swap>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:vcpus>1</nova:vcpus>
Nov 15 12:55:18 user nova-compute[75813]:   </nova:flavor>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:owner>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:user uuid="74615b8601894772b20328f7b894c9a1">tempest-TaggedAttachmentsTest-1179121499-project-member</nova:user>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:project uuid="ce97b303bdb940c59d6cea5ad91ef0d4">tempest-TaggedAttachmentsTest-1179121499</nova:project>
Nov 15 12:55:18 user nova-compute[75813]:   </nova:owner>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:ports>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:port uuid="637149a0-24b9-4fed-8cc4-6dd3a909c874">
Nov 15 12:55:18 user nova-compute[75813]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 12:55:18 user nova-compute[75813]:     </nova:port>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:port uuid="b46434a3-ad87-45e7-bbb1-a01ac2a871d7">
Nov 15 12:55:18 user nova-compute[75813]:       <nova:ip type="fixed" address="10.10.10.25" ipVersion="4"/>
Nov 15 12:55:18 user nova-compute[75813]:     </nova:port>
Nov 15 12:55:18 user nova-compute[75813]:   </nova:ports>
Nov 15 12:55:18 user nova-compute[75813]: </nova:instance>
Nov 15 12:55:18 user nova-compute[75813]:   </metadata>
Nov 15 12:55:18 user nova-compute[75813]:   <memory unit='KiB'>524288</memory>
Nov 15 12:55:18 user nova-compute[75813]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 12:55:18 user nova-compute[75813]:   <vcpu placement='static'>1</vcpu>
Nov 15 12:55:18 user nova-compute[75813]:   <resource>
Nov 15 12:55:18 user nova-compute[75813]:     <partition>/machine</partition>
Nov 15 12:55:18 user nova-compute[75813]:   </resource>
Nov 15 12:55:18 user nova-compute[75813]:   <sysinfo type='smbios'>
Nov 15 12:55:18 user nova-compute[75813]:     <system>
Nov 15 12:55:18 user nova-compute[75813]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 12:55:18 user nova-compute[75813]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 12:55:18 user nova-compute[75813]:       <entry name='version'>0.0.0</entry>
Nov 15 12:55:18 user nova-compute[75813]:       <entry name='serial'>868f2db9-e52c-4f9a-8bd3-18ec6807377e</entry>
Nov 15 12:55:18 user nova-compute[75813]:       <entry name='uuid'>868f2db9-e52c-4f9a-8bd3-18ec6807377e</entry>
Nov 15 12:55:18 user nova-compute[75813]:       <entry name='family'>Virtual Machine</entry>
Nov 15 12:55:18 user nova-compute[75813]:     </system>
Nov 15 12:55:18 user nova-compute[75813]:   </sysinfo>
Nov 15 12:55:18 user nova-compute[75813]:   <os>
Nov 15 12:55:18 user nova-compute[75813]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 12:55:18 user nova-compute[75813]:     <boot dev='hd'/>
Nov 15 12:55:18 user nova-compute[75813]:     <smbios mode='sysinfo'/>
Nov 15 12:55:18 user nova-compute[75813]:   </os>
Nov 15 12:55:18 user nova-compute[75813]:   <features>
Nov 15 12:55:18 user nova-compute[75813]:     <acpi/>
Nov 15 12:55:18 user nova-compute[75813]:     <apic/>
Nov 15 12:55:18 user nova-compute[75813]:     <vmcoreinfo state='on'/>
Nov 15 12:55:18 user nova-compute[75813]:   </features>
Nov 15 12:55:18 user nova-compute[75813]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 12:55:18 user nova-compute[75813]:     <model fallback='forbid'>Nehalem</model>
Nov 15 12:55:18 user nova-compute[75813]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 12:55:18 user nova-compute[75813]:     <feature policy='require' name='vme'/>
Nov 15 12:55:18 user nova-compute[75813]:     <feature policy='require' name='x2apic'/>
Nov 15 12:55:18 user nova-compute[75813]:     <feature policy='require' name='hypervisor'/>
Nov 15 12:55:18 user nova-compute[75813]:   </cpu>
Nov 15 12:55:18 user nova-compute[75813]:   <clock offset='utc'>
Nov 15 12:55:18 user nova-compute[75813]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 12:55:18 user nova-compute[75813]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 12:55:18 user nova-compute[75813]:     <timer name='hpet' present='no'/>
Nov 15 12:55:18 user nova-compute[75813]:   </clock>
Nov 15 12:55:18 user nova-compute[75813]:   <on_poweroff>destroy</on_poweroff>
Nov 15 12:55:18 user nova-compute[75813]:   <on_reboot>restart</on_reboot>
Nov 15 12:55:18 user nova-compute[75813]:   <on_crash>destroy</on_crash>
Nov 15 12:55:18 user nova-compute[75813]:   <devices>
Nov 15 12:55:18 user nova-compute[75813]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 12:55:18 user nova-compute[75813]:     <disk type='file' device='disk'>
Nov 15 12:55:18 user nova-compute[75813]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 12:55:18 user nova-compute[75813]:       <source file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk' index='2'/>
Nov 15 12:55:18 user nova-compute[75813]:       <backingStore type='file' index='3'>
Nov 15 12:55:18 user nova-compute[75813]:         <format type='raw'/>
Nov 15 12:55:18 user nova-compute[75813]:         <source file='/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4'/>
Nov 15 12:55:18 user nova-compute[75813]:         <backingStore/>
Nov 15 12:55:18 user nova-compute[75813]:       </backingStore>
Nov 15 12:55:18 user nova-compute[75813]:       <target dev='vda' bus='virtio'/>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='virtio-disk0'/>
Nov 15 12:55:18 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 12:55:18 user nova-compute[75813]:     </disk>
Nov 15 12:55:18 user nova-compute[75813]:     <disk type='file' device='cdrom'>
Nov 15 12:55:18 user nova-compute[75813]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 12:55:18 user nova-compute[75813]:       <source file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk.config' index='1'/>
Nov 15 12:55:18 user nova-compute[75813]:       <backingStore/>
Nov 15 12:55:18 user nova-compute[75813]:       <target dev='hda' bus='ide'/>
Nov 15 12:55:18 user nova-compute[75813]:       <readonly/>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='ide0-0-0'/>
Nov 15 12:55:18 user nova-compute[75813]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 12:55:18 user nova-compute[75813]:     </disk>
Nov 15 12:55:18 user nova-compute[75813]:     <controller type='usb' index='0' model='none'>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='usb'/>
Nov 15 12:55:18 user nova-compute[75813]:     </controller>
Nov 15 12:55:18 user nova-compute[75813]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='pci.0'/>
Nov 15 12:55:18 user nova-compute[75813]:     </controller>
Nov 15 12:55:18 user nova-compute[75813]:     <controller type='ide' index='0'>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='ide'/>
Nov 15 12:55:18 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 12:55:18 user nova-compute[75813]:     </controller>
Nov 15 12:55:18 user nova-compute[75813]:     <interface type='ethernet'>
Nov 15 12:55:18 user nova-compute[75813]:       <mac address='fa:16:3e:e0:6d:60'/>
Nov 15 12:55:18 user nova-compute[75813]:       <target dev='tap637149a0-24'/>
Nov 15 12:55:18 user nova-compute[75813]:       <model type='virtio'/>
Nov 15 12:55:18 user nova-compute[75813]:       <mtu size='1442'/>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='net0'/>
Nov 15 12:55:18 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 12:55:18 user nova-compute[75813]:     </interface>
Nov 15 12:55:18 user nova-compute[75813]:     <serial type='pty'>
Nov 15 12:55:18 user nova-compute[75813]:       <source path='/dev/pts/6'/>
Nov 15 12:55:18 user nova-compute[75813]:       <log file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/console.log' append='off'/>
Nov 15 12:55:18 user nova-compute[75813]:       <target type='isa-serial' port='0'>
Nov 15 12:55:18 user nova-compute[75813]:         <model name='isa-serial'/>
Nov 15 12:55:18 user nova-compute[75813]:       </target>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='serial0'/>
Nov 15 12:55:18 user nova-compute[75813]:     </serial>
Nov 15 12:55:18 user nova-compute[75813]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 12:55:18 user nova-compute[75813]:       <source path='/dev/pts/6'/>
Nov 15 12:55:18 user nova-compute[75813]:       <log file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/console.log' append='off'/>
Nov 15 12:55:18 user nova-compute[75813]:       <target type='serial' port='0'/>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='serial0'/>
Nov 15 12:55:18 user nova-compute[75813]:     </console>
Nov 15 12:55:18 user nova-compute[75813]:     <input type='mouse' bus='ps2'>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='input0'/>
Nov 15 12:55:18 user nova-compute[75813]:     </input>
Nov 15 12:55:18 user nova-compute[75813]:     <input type='keyboard' bus='ps2'>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='input1'/>
Nov 15 12:55:18 user nova-compute[75813]:     </input>
Nov 15 12:55:18 user nova-compute[75813]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 12:55:18 user nova-compute[75813]:       <listen type='address' address='0.0.0.0'/>
Nov 15 12:55:18 user nova-compute[75813]:     </graphics>
Nov 15 12:55:18 user nova-compute[75813]:     <audio id='1' type='none'/>
Nov 15 12:55:18 user nova-compute[75813]:     <video>
Nov 15 12:55:18 user nova-compute[75813]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='video0'/>
Nov 15 12:55:18 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 12:55:18 user nova-compute[75813]:     </video>
Nov 15 12:55:18 user nova-compute[75813]:     <memballoon model='virtio'>
Nov 15 12:55:18 user nova-compute[75813]:       <stats period='10'/>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='balloon0'/>
Nov 15 12:55:18 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 12:55:18 user nova-compute[75813]:     </memballoon>
Nov 15 12:55:18 user nova-compute[75813]:     <rng model='virtio'>
Nov 15 12:55:18 user nova-compute[75813]:       <backend model='random'>/dev/urandom</backend>
Nov 15 12:55:18 user nova-compute[75813]:       <alias name='rng0'/>
Nov 15 12:55:18 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 12:55:18 user nova-compute[75813]:     </rng>
Nov 15 12:55:18 user nova-compute[75813]:   </devices>
Nov 15 12:55:18 user nova-compute[75813]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 12:55:18 user nova-compute[75813]:     <label>libvirt-868f2db9-e52c-4f9a-8bd3-18ec6807377e</label>
Nov 15 12:55:18 user nova-compute[75813]:     <imagelabel>libvirt-868f2db9-e52c-4f9a-8bd3-18ec6807377e</imagelabel>
Nov 15 12:55:18 user nova-compute[75813]:   </seclabel>
Nov 15 12:55:18 user nova-compute[75813]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 12:55:18 user nova-compute[75813]:     <label>+64055:+108</label>
Nov 15 12:55:18 user nova-compute[75813]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 12:55:18 user nova-compute[75813]:   </seclabel>
Nov 15 12:55:18 user nova-compute[75813]: </domain>
Nov 15 12:55:18 user nova-compute[75813]:  {{(pid=75813) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 12:55:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Successfully detached device tapb46434a3-ad from instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e from the live domain config.
Nov 15 12:55:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211354557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211354557',id=15,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy1dLT3BMBPj0HMd2wO6SlIfeOmZ5zLbEAioS6Myt1UETKqLiMh/MFli0JtJDPjUkaSiV8utv6xgh1ZfE1PdfxOgyxPJzAm7dYkPDYpHgRwmjqP16hyPEVizDOZD284gw==',key_name='tempest-keypair-1348731404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce97b303bdb940c59d6cea5ad91ef0d4',ramdisk_id='',reservation_id='r-mq0pxr7o',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179121499',owner_user_name='tempest-TaggedAttachmentsTest-1179121499-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74615b8601894772b20328f7b894c9a1',uuid=868f2db9-e52c-4f9a-8bd3-18ec6807377e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converting VIF {"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG os_vif [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb46434a3-ad, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1330e61-0942-479d-baa0-0597b7c37479) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:18 user nova-compute[75813]: INFO os_vif [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad')
Nov 15 12:55:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:55:18 user nova-compute[75813]:   <nova:package version="0.0.0"/>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:name>tempest-device-tagging-server-211354557</nova:name>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:creationTime>2023-11-15 12:55:18</nova:creationTime>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:flavor name="m1.tiny">
Nov 15 12:55:18 user nova-compute[75813]:     <nova:memory>512</nova:memory>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:disk>1</nova:disk>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:swap>0</nova:swap>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:vcpus>1</nova:vcpus>
Nov 15 12:55:18 user nova-compute[75813]:   </nova:flavor>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:owner>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:user uuid="74615b8601894772b20328f7b894c9a1">tempest-TaggedAttachmentsTest-1179121499-project-member</nova:user>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:project uuid="ce97b303bdb940c59d6cea5ad91ef0d4">tempest-TaggedAttachmentsTest-1179121499</nova:project>
Nov 15 12:55:18 user nova-compute[75813]:   </nova:owner>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:55:18 user nova-compute[75813]:   <nova:ports>
Nov 15 12:55:18 user nova-compute[75813]:     <nova:port uuid="637149a0-24b9-4fed-8cc4-6dd3a909c874">
Nov 15 12:55:18 user nova-compute[75813]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 12:55:18 user nova-compute[75813]:     </nova:port>
Nov 15 12:55:18 user nova-compute[75813]:   </nova:ports>
Nov 15 12:55:18 user nova-compute[75813]: </nova:instance>
Nov 15 12:55:18 user nova-compute[75813]:  {{(pid=75813) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-vif-deleted-b46434a3-ad87-45e7-bbb1-a01ac2a871d7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:19 user nova-compute[75813]: INFO nova.compute.manager [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Neutron deleted interface b46434a3-ad87-45e7-bbb1-a01ac2a871d7; detaching it from the instance and deleting it from the info cache
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.network.neutron [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updating instance_info_cache with network_info: [{"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquired lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.network.neutron [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.objects.instance [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] Lazy-loading 'system_metadata' on Instance uuid 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.objects.instance [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] Lazy-loading 'flavor' on Instance uuid 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.objects.base [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] Object Instance<868f2db9-e52c-4f9a-8bd3-18ec6807377e> lazy-loaded attributes: system_metadata,flavor {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211354557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211354557',id=15,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy1dLT3BMBPj0HMd2wO6SlIfeOmZ5zLbEAioS6Myt1UETKqLiMh/MFli0JtJDPjUkaSiV8utv6xgh1ZfE1PdfxOgyxPJzAm7dYkPDYpHgRwmjqP16hyPEVizDOZD284gw==',key_name='tempest-keypair-1348731404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce97b303bdb940c59d6cea5ad91ef0d4',ramdisk_id='',reservation_id='r-mq0pxr7o',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179121499',owner_user_name='tempest-TaggedAttachmentsTest-1179121499-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74615b8601894772b20328f7b894c9a1',uuid=868f2db9-e52c-4f9a-8bd3-18ec6807377e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.network.os_vif_util [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] Converting VIF {"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.network.os_vif_util [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:bb:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tapb46434a3-ad"/></interface> {{(pid=75813) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:05:bb:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tapb46434a3-ad"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 15 12:55:19 user nova-compute[75813]:   <name>instance-0000000f</name>
Nov 15 12:55:19 user nova-compute[75813]:   <uuid>868f2db9-e52c-4f9a-8bd3-18ec6807377e</uuid>
Nov 15 12:55:19 user nova-compute[75813]:   <metadata>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:55:19 user nova-compute[75813]:   <nova:package version="0.0.0"/>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:name>tempest-device-tagging-server-211354557</nova:name>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:creationTime>2023-11-15 12:55:18</nova:creationTime>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:flavor name="m1.tiny">
Nov 15 12:55:19 user nova-compute[75813]:     <nova:memory>512</nova:memory>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:disk>1</nova:disk>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:swap>0</nova:swap>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:vcpus>1</nova:vcpus>
Nov 15 12:55:19 user nova-compute[75813]:   </nova:flavor>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:owner>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:user uuid="74615b8601894772b20328f7b894c9a1">tempest-TaggedAttachmentsTest-1179121499-project-member</nova:user>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:project uuid="ce97b303bdb940c59d6cea5ad91ef0d4">tempest-TaggedAttachmentsTest-1179121499</nova:project>
Nov 15 12:55:19 user nova-compute[75813]:   </nova:owner>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:ports>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:port uuid="637149a0-24b9-4fed-8cc4-6dd3a909c874">
Nov 15 12:55:19 user nova-compute[75813]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 12:55:19 user nova-compute[75813]:     </nova:port>
Nov 15 12:55:19 user nova-compute[75813]:   </nova:ports>
Nov 15 12:55:19 user nova-compute[75813]: </nova:instance>
Nov 15 12:55:19 user nova-compute[75813]:   </metadata>
Nov 15 12:55:19 user nova-compute[75813]:   <memory unit='KiB'>524288</memory>
Nov 15 12:55:19 user nova-compute[75813]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 12:55:19 user nova-compute[75813]:   <vcpu placement='static'>1</vcpu>
Nov 15 12:55:19 user nova-compute[75813]:   <resource>
Nov 15 12:55:19 user nova-compute[75813]:     <partition>/machine</partition>
Nov 15 12:55:19 user nova-compute[75813]:   </resource>
Nov 15 12:55:19 user nova-compute[75813]:   <sysinfo type='smbios'>
Nov 15 12:55:19 user nova-compute[75813]:     <system>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='version'>0.0.0</entry>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='serial'>868f2db9-e52c-4f9a-8bd3-18ec6807377e</entry>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='uuid'>868f2db9-e52c-4f9a-8bd3-18ec6807377e</entry>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='family'>Virtual Machine</entry>
Nov 15 12:55:19 user nova-compute[75813]:     </system>
Nov 15 12:55:19 user nova-compute[75813]:   </sysinfo>
Nov 15 12:55:19 user nova-compute[75813]:   <os>
Nov 15 12:55:19 user nova-compute[75813]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 12:55:19 user nova-compute[75813]:     <boot dev='hd'/>
Nov 15 12:55:19 user nova-compute[75813]:     <smbios mode='sysinfo'/>
Nov 15 12:55:19 user nova-compute[75813]:   </os>
Nov 15 12:55:19 user nova-compute[75813]:   <features>
Nov 15 12:55:19 user nova-compute[75813]:     <acpi/>
Nov 15 12:55:19 user nova-compute[75813]:     <apic/>
Nov 15 12:55:19 user nova-compute[75813]:     <vmcoreinfo state='on'/>
Nov 15 12:55:19 user nova-compute[75813]:   </features>
Nov 15 12:55:19 user nova-compute[75813]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 12:55:19 user nova-compute[75813]:     <model fallback='forbid'>Nehalem</model>
Nov 15 12:55:19 user nova-compute[75813]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 12:55:19 user nova-compute[75813]:     <feature policy='require' name='vme'/>
Nov 15 12:55:19 user nova-compute[75813]:     <feature policy='require' name='x2apic'/>
Nov 15 12:55:19 user nova-compute[75813]:     <feature policy='require' name='hypervisor'/>
Nov 15 12:55:19 user nova-compute[75813]:   </cpu>
Nov 15 12:55:19 user nova-compute[75813]:   <clock offset='utc'>
Nov 15 12:55:19 user nova-compute[75813]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 12:55:19 user nova-compute[75813]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 12:55:19 user nova-compute[75813]:     <timer name='hpet' present='no'/>
Nov 15 12:55:19 user nova-compute[75813]:   </clock>
Nov 15 12:55:19 user nova-compute[75813]:   <on_poweroff>destroy</on_poweroff>
Nov 15 12:55:19 user nova-compute[75813]:   <on_reboot>restart</on_reboot>
Nov 15 12:55:19 user nova-compute[75813]:   <on_crash>destroy</on_crash>
Nov 15 12:55:19 user nova-compute[75813]:   <devices>
Nov 15 12:55:19 user nova-compute[75813]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 12:55:19 user nova-compute[75813]:     <disk type='file' device='disk'>
Nov 15 12:55:19 user nova-compute[75813]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 12:55:19 user nova-compute[75813]:       <source file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk' index='2'/>
Nov 15 12:55:19 user nova-compute[75813]:       <backingStore type='file' index='3'>
Nov 15 12:55:19 user nova-compute[75813]:         <format type='raw'/>
Nov 15 12:55:19 user nova-compute[75813]:         <source file='/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4'/>
Nov 15 12:55:19 user nova-compute[75813]:         <backingStore/>
Nov 15 12:55:19 user nova-compute[75813]:       </backingStore>
Nov 15 12:55:19 user nova-compute[75813]:       <target dev='vda' bus='virtio'/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='virtio-disk0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </disk>
Nov 15 12:55:19 user nova-compute[75813]:     <disk type='file' device='cdrom'>
Nov 15 12:55:19 user nova-compute[75813]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 12:55:19 user nova-compute[75813]:       <source file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk.config' index='1'/>
Nov 15 12:55:19 user nova-compute[75813]:       <backingStore/>
Nov 15 12:55:19 user nova-compute[75813]:       <target dev='hda' bus='ide'/>
Nov 15 12:55:19 user nova-compute[75813]:       <readonly/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='ide0-0-0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </disk>
Nov 15 12:55:19 user nova-compute[75813]:     <controller type='usb' index='0' model='none'>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='usb'/>
Nov 15 12:55:19 user nova-compute[75813]:     </controller>
Nov 15 12:55:19 user nova-compute[75813]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='pci.0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </controller>
Nov 15 12:55:19 user nova-compute[75813]:     <controller type='ide' index='0'>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='ide'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 12:55:19 user nova-compute[75813]:     </controller>
Nov 15 12:55:19 user nova-compute[75813]:     <interface type='ethernet'>
Nov 15 12:55:19 user nova-compute[75813]:       <mac address='fa:16:3e:e0:6d:60'/>
Nov 15 12:55:19 user nova-compute[75813]:       <target dev='tap637149a0-24'/>
Nov 15 12:55:19 user nova-compute[75813]:       <model type='virtio'/>
Nov 15 12:55:19 user nova-compute[75813]:       <mtu size='1442'/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='net0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </interface>
Nov 15 12:55:19 user nova-compute[75813]:     <serial type='pty'>
Nov 15 12:55:19 user nova-compute[75813]:       <source path='/dev/pts/6'/>
Nov 15 12:55:19 user nova-compute[75813]:       <log file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/console.log' append='off'/>
Nov 15 12:55:19 user nova-compute[75813]:       <target type='isa-serial' port='0'>
Nov 15 12:55:19 user nova-compute[75813]:         <model name='isa-serial'/>
Nov 15 12:55:19 user nova-compute[75813]:       </target>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='serial0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </serial>
Nov 15 12:55:19 user nova-compute[75813]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 12:55:19 user nova-compute[75813]:       <source path='/dev/pts/6'/>
Nov 15 12:55:19 user nova-compute[75813]:       <log file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/console.log' append='off'/>
Nov 15 12:55:19 user nova-compute[75813]:       <target type='serial' port='0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='serial0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </console>
Nov 15 12:55:19 user nova-compute[75813]:     <input type='mouse' bus='ps2'>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='input0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </input>
Nov 15 12:55:19 user nova-compute[75813]:     <input type='keyboard' bus='ps2'>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='input1'/>
Nov 15 12:55:19 user nova-compute[75813]:     </input>
Nov 15 12:55:19 user nova-compute[75813]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 12:55:19 user nova-compute[75813]:       <listen type='address' address='0.0.0.0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </graphics>
Nov 15 12:55:19 user nova-compute[75813]:     <audio id='1' type='none'/>
Nov 15 12:55:19 user nova-compute[75813]:     <video>
Nov 15 12:55:19 user nova-compute[75813]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='video0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </video>
Nov 15 12:55:19 user nova-compute[75813]:     <memballoon model='virtio'>
Nov 15 12:55:19 user nova-compute[75813]:       <stats period='10'/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='balloon0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </memballoon>
Nov 15 12:55:19 user nova-compute[75813]:     <rng model='virtio'>
Nov 15 12:55:19 user nova-compute[75813]:       <backend model='random'>/dev/urandom</backend>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='rng0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </rng>
Nov 15 12:55:19 user nova-compute[75813]:   </devices>
Nov 15 12:55:19 user nova-compute[75813]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 12:55:19 user nova-compute[75813]:     <label>libvirt-868f2db9-e52c-4f9a-8bd3-18ec6807377e</label>
Nov 15 12:55:19 user nova-compute[75813]:     <imagelabel>libvirt-868f2db9-e52c-4f9a-8bd3-18ec6807377e</imagelabel>
Nov 15 12:55:19 user nova-compute[75813]:   </seclabel>
Nov 15 12:55:19 user nova-compute[75813]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 12:55:19 user nova-compute[75813]:     <label>+64055:+108</label>
Nov 15 12:55:19 user nova-compute[75813]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 12:55:19 user nova-compute[75813]:   </seclabel>
Nov 15 12:55:19 user nova-compute[75813]: </domain>
Nov 15 12:55:19 user nova-compute[75813]:  {{(pid=75813) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:bb:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tapb46434a3-ad"/></interface> {{(pid=75813) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:05:bb:ea"/><model type="virtio"/><mtu size="1442"/><target dev="tapb46434a3-ad"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 15 12:55:19 user nova-compute[75813]:   <name>instance-0000000f</name>
Nov 15 12:55:19 user nova-compute[75813]:   <uuid>868f2db9-e52c-4f9a-8bd3-18ec6807377e</uuid>
Nov 15 12:55:19 user nova-compute[75813]:   <metadata>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:55:19 user nova-compute[75813]:   <nova:package version="0.0.0"/>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:name>tempest-device-tagging-server-211354557</nova:name>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:creationTime>2023-11-15 12:55:18</nova:creationTime>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:flavor name="m1.tiny">
Nov 15 12:55:19 user nova-compute[75813]:     <nova:memory>512</nova:memory>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:disk>1</nova:disk>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:swap>0</nova:swap>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:vcpus>1</nova:vcpus>
Nov 15 12:55:19 user nova-compute[75813]:   </nova:flavor>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:owner>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:user uuid="74615b8601894772b20328f7b894c9a1">tempest-TaggedAttachmentsTest-1179121499-project-member</nova:user>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:project uuid="ce97b303bdb940c59d6cea5ad91ef0d4">tempest-TaggedAttachmentsTest-1179121499</nova:project>
Nov 15 12:55:19 user nova-compute[75813]:   </nova:owner>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:ports>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:port uuid="637149a0-24b9-4fed-8cc4-6dd3a909c874">
Nov 15 12:55:19 user nova-compute[75813]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 12:55:19 user nova-compute[75813]:     </nova:port>
Nov 15 12:55:19 user nova-compute[75813]:   </nova:ports>
Nov 15 12:55:19 user nova-compute[75813]: </nova:instance>
Nov 15 12:55:19 user nova-compute[75813]:   </metadata>
Nov 15 12:55:19 user nova-compute[75813]:   <memory unit='KiB'>524288</memory>
Nov 15 12:55:19 user nova-compute[75813]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 12:55:19 user nova-compute[75813]:   <vcpu placement='static'>1</vcpu>
Nov 15 12:55:19 user nova-compute[75813]:   <resource>
Nov 15 12:55:19 user nova-compute[75813]:     <partition>/machine</partition>
Nov 15 12:55:19 user nova-compute[75813]:   </resource>
Nov 15 12:55:19 user nova-compute[75813]:   <sysinfo type='smbios'>
Nov 15 12:55:19 user nova-compute[75813]:     <system>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='version'>0.0.0</entry>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='serial'>868f2db9-e52c-4f9a-8bd3-18ec6807377e</entry>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='uuid'>868f2db9-e52c-4f9a-8bd3-18ec6807377e</entry>
Nov 15 12:55:19 user nova-compute[75813]:       <entry name='family'>Virtual Machine</entry>
Nov 15 12:55:19 user nova-compute[75813]:     </system>
Nov 15 12:55:19 user nova-compute[75813]:   </sysinfo>
Nov 15 12:55:19 user nova-compute[75813]:   <os>
Nov 15 12:55:19 user nova-compute[75813]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 12:55:19 user nova-compute[75813]:     <boot dev='hd'/>
Nov 15 12:55:19 user nova-compute[75813]:     <smbios mode='sysinfo'/>
Nov 15 12:55:19 user nova-compute[75813]:   </os>
Nov 15 12:55:19 user nova-compute[75813]:   <features>
Nov 15 12:55:19 user nova-compute[75813]:     <acpi/>
Nov 15 12:55:19 user nova-compute[75813]:     <apic/>
Nov 15 12:55:19 user nova-compute[75813]:     <vmcoreinfo state='on'/>
Nov 15 12:55:19 user nova-compute[75813]:   </features>
Nov 15 12:55:19 user nova-compute[75813]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 12:55:19 user nova-compute[75813]:     <model fallback='forbid'>Nehalem</model>
Nov 15 12:55:19 user nova-compute[75813]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 12:55:19 user nova-compute[75813]:     <feature policy='require' name='vme'/>
Nov 15 12:55:19 user nova-compute[75813]:     <feature policy='require' name='x2apic'/>
Nov 15 12:55:19 user nova-compute[75813]:     <feature policy='require' name='hypervisor'/>
Nov 15 12:55:19 user nova-compute[75813]:   </cpu>
Nov 15 12:55:19 user nova-compute[75813]:   <clock offset='utc'>
Nov 15 12:55:19 user nova-compute[75813]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 12:55:19 user nova-compute[75813]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 12:55:19 user nova-compute[75813]:     <timer name='hpet' present='no'/>
Nov 15 12:55:19 user nova-compute[75813]:   </clock>
Nov 15 12:55:19 user nova-compute[75813]:   <on_poweroff>destroy</on_poweroff>
Nov 15 12:55:19 user nova-compute[75813]:   <on_reboot>restart</on_reboot>
Nov 15 12:55:19 user nova-compute[75813]:   <on_crash>destroy</on_crash>
Nov 15 12:55:19 user nova-compute[75813]:   <devices>
Nov 15 12:55:19 user nova-compute[75813]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 12:55:19 user nova-compute[75813]:     <disk type='file' device='disk'>
Nov 15 12:55:19 user nova-compute[75813]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 12:55:19 user nova-compute[75813]:       <source file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk' index='2'/>
Nov 15 12:55:19 user nova-compute[75813]:       <backingStore type='file' index='3'>
Nov 15 12:55:19 user nova-compute[75813]:         <format type='raw'/>
Nov 15 12:55:19 user nova-compute[75813]:         <source file='/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4'/>
Nov 15 12:55:19 user nova-compute[75813]:         <backingStore/>
Nov 15 12:55:19 user nova-compute[75813]:       </backingStore>
Nov 15 12:55:19 user nova-compute[75813]:       <target dev='vda' bus='virtio'/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='virtio-disk0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </disk>
Nov 15 12:55:19 user nova-compute[75813]:     <disk type='file' device='cdrom'>
Nov 15 12:55:19 user nova-compute[75813]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 12:55:19 user nova-compute[75813]:       <source file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk.config' index='1'/>
Nov 15 12:55:19 user nova-compute[75813]:       <backingStore/>
Nov 15 12:55:19 user nova-compute[75813]:       <target dev='hda' bus='ide'/>
Nov 15 12:55:19 user nova-compute[75813]:       <readonly/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='ide0-0-0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </disk>
Nov 15 12:55:19 user nova-compute[75813]:     <controller type='usb' index='0' model='none'>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='usb'/>
Nov 15 12:55:19 user nova-compute[75813]:     </controller>
Nov 15 12:55:19 user nova-compute[75813]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='pci.0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </controller>
Nov 15 12:55:19 user nova-compute[75813]:     <controller type='ide' index='0'>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='ide'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 12:55:19 user nova-compute[75813]:     </controller>
Nov 15 12:55:19 user nova-compute[75813]:     <interface type='ethernet'>
Nov 15 12:55:19 user nova-compute[75813]:       <mac address='fa:16:3e:e0:6d:60'/>
Nov 15 12:55:19 user nova-compute[75813]:       <target dev='tap637149a0-24'/>
Nov 15 12:55:19 user nova-compute[75813]:       <model type='virtio'/>
Nov 15 12:55:19 user nova-compute[75813]:       <mtu size='1442'/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='net0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </interface>
Nov 15 12:55:19 user nova-compute[75813]:     <serial type='pty'>
Nov 15 12:55:19 user nova-compute[75813]:       <source path='/dev/pts/6'/>
Nov 15 12:55:19 user nova-compute[75813]:       <log file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/console.log' append='off'/>
Nov 15 12:55:19 user nova-compute[75813]:       <target type='isa-serial' port='0'>
Nov 15 12:55:19 user nova-compute[75813]:         <model name='isa-serial'/>
Nov 15 12:55:19 user nova-compute[75813]:       </target>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='serial0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </serial>
Nov 15 12:55:19 user nova-compute[75813]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 12:55:19 user nova-compute[75813]:       <source path='/dev/pts/6'/>
Nov 15 12:55:19 user nova-compute[75813]:       <log file='/opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/console.log' append='off'/>
Nov 15 12:55:19 user nova-compute[75813]:       <target type='serial' port='0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='serial0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </console>
Nov 15 12:55:19 user nova-compute[75813]:     <input type='mouse' bus='ps2'>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='input0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </input>
Nov 15 12:55:19 user nova-compute[75813]:     <input type='keyboard' bus='ps2'>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='input1'/>
Nov 15 12:55:19 user nova-compute[75813]:     </input>
Nov 15 12:55:19 user nova-compute[75813]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 12:55:19 user nova-compute[75813]:       <listen type='address' address='0.0.0.0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </graphics>
Nov 15 12:55:19 user nova-compute[75813]:     <audio id='1' type='none'/>
Nov 15 12:55:19 user nova-compute[75813]:     <video>
Nov 15 12:55:19 user nova-compute[75813]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='video0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </video>
Nov 15 12:55:19 user nova-compute[75813]:     <memballoon model='virtio'>
Nov 15 12:55:19 user nova-compute[75813]:       <stats period='10'/>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='balloon0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </memballoon>
Nov 15 12:55:19 user nova-compute[75813]:     <rng model='virtio'>
Nov 15 12:55:19 user nova-compute[75813]:       <backend model='random'>/dev/urandom</backend>
Nov 15 12:55:19 user nova-compute[75813]:       <alias name='rng0'/>
Nov 15 12:55:19 user nova-compute[75813]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 12:55:19 user nova-compute[75813]:     </rng>
Nov 15 12:55:19 user nova-compute[75813]:   </devices>
Nov 15 12:55:19 user nova-compute[75813]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 12:55:19 user nova-compute[75813]:     <label>libvirt-868f2db9-e52c-4f9a-8bd3-18ec6807377e</label>
Nov 15 12:55:19 user nova-compute[75813]:     <imagelabel>libvirt-868f2db9-e52c-4f9a-8bd3-18ec6807377e</imagelabel>
Nov 15 12:55:19 user nova-compute[75813]:   </seclabel>
Nov 15 12:55:19 user nova-compute[75813]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 12:55:19 user nova-compute[75813]:     <label>+64055:+108</label>
Nov 15 12:55:19 user nova-compute[75813]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 12:55:19 user nova-compute[75813]:   </seclabel>
Nov 15 12:55:19 user nova-compute[75813]: </domain>
Nov 15 12:55:19 user nova-compute[75813]:  {{(pid=75813) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 12:55:19 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Detaching interface fa:16:3e:05:bb:ea failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapb46434a3-ad' not found.
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211354557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211354557',id=15,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy1dLT3BMBPj0HMd2wO6SlIfeOmZ5zLbEAioS6Myt1UETKqLiMh/MFli0JtJDPjUkaSiV8utv6xgh1ZfE1PdfxOgyxPJzAm7dYkPDYpHgRwmjqP16hyPEVizDOZD284gw==',key_name='tempest-keypair-1348731404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce97b303bdb940c59d6cea5ad91ef0d4',ramdisk_id='',reservation_id='r-mq0pxr7o',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179121499',owner_user_name='tempest-TaggedAttachmentsTest-1179121499-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74615b8601894772b20328f7b894c9a1',uuid=868f2db9-e52c-4f9a-8bd3-18ec6807377e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.network.os_vif_util [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] Converting VIF {"id": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "address": "fa:16:3e:05:bb:ea", "network": {"id": "c59bb26c-f011-44f1-a65f-169666b96856", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1180655014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb46434a3-ad", "ovs_interfaceid": "b46434a3-ad87-45e7-bbb1-a01ac2a871d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.network.os_vif_util [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG os_vif [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb46434a3-ad, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:55:19 user nova-compute[75813]: INFO os_vif [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=b46434a3-ad87-45e7-bbb1-a01ac2a871d7,network=Network(c59bb26c-f011-44f1-a65f-169666b96856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb46434a3-ad')
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [req-34307177-791b-4b4f-8d14-68b43f07999e req-93d74765-9487-45e6-960e-9857a2f2204c service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:55:19 user nova-compute[75813]:   <nova:package version="0.0.0"/>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:name>tempest-device-tagging-server-211354557</nova:name>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:creationTime>2023-11-15 12:55:19</nova:creationTime>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:flavor name="m1.tiny">
Nov 15 12:55:19 user nova-compute[75813]:     <nova:memory>512</nova:memory>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:disk>1</nova:disk>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:swap>0</nova:swap>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:vcpus>1</nova:vcpus>
Nov 15 12:55:19 user nova-compute[75813]:   </nova:flavor>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:owner>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:user uuid="74615b8601894772b20328f7b894c9a1">tempest-TaggedAttachmentsTest-1179121499-project-member</nova:user>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:project uuid="ce97b303bdb940c59d6cea5ad91ef0d4">tempest-TaggedAttachmentsTest-1179121499</nova:project>
Nov 15 12:55:19 user nova-compute[75813]:   </nova:owner>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:55:19 user nova-compute[75813]:   <nova:ports>
Nov 15 12:55:19 user nova-compute[75813]:     <nova:port uuid="637149a0-24b9-4fed-8cc4-6dd3a909c874">
Nov 15 12:55:19 user nova-compute[75813]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 12:55:19 user nova-compute[75813]:     </nova:port>
Nov 15 12:55:19 user nova-compute[75813]:   </nova:ports>
Nov 15 12:55:19 user nova-compute[75813]: </nova:instance>
Nov 15 12:55:19 user nova-compute[75813]:  {{(pid=75813) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG nova.network.neutron [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updating instance_info_cache with network_info: [{"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Releasing lock "refresh_cache-868f2db9-e52c-4f9a-8bd3-18ec6807377e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:55:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-faf8212b-9e0e-41c4-afc0-ab41bdc3d673 tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "interface-868f2db9-e52c-4f9a-8bd3-18ec6807377e-b46434a3-ad87-45e7-bbb1-a01ac2a871d7" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.726s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG nova.objects.instance [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:20 user nova-compute[75813]: INFO nova.compute.manager [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attaching volume f634465f-22b4-4b24-b2ad-a73b34800faf to /dev/vdb
Nov 15 12:55:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG os_brick.utils [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c8fe6d-a693-46b4-9441-665c2b33e7bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac805c93-77bb-4395-88d1-5a014cf8e213]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88ec0b1-2762-46f3-83c4-e63829ef8e3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d450152c-50b9-4f9d-8c7c-91c96ad2bc1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:55:20 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:55:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[090da1ae-009f-403c-8b83-2941511a03f9]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG os_brick.utils [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:55:20 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updating existing volume attachment record: 3499106c-3b2e-49e3-ae86-53cb068dfa87 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:55:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuTVhvdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:55:25 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:55:25 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:55:25 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd150ec-e5e0-42af-8256-06b9a06532cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:55:25 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[83225bcc-5e39-4716-b663-1741e6cacb37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf] added
Nov 15 12:55:25 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5129b42-441d-4d4b-b660-b0864d437e8a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1835525b-819d-4fa2-8c09-98f3bf7b12b5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuTVhvdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuTVhvdc" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[467c8964-1121-41e0-9726-f4c8ee7efc39]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YuTVhvdc'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c07613-abc8-4e65-9cd6-a25e3232fb1e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[44541cb5-009e-4a5a-861b-95739f2a1a6d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff93084-dbdb-4b89-bfc4-659782d34a60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf, portal: 172.16.0.220,3260]
Nov 15 12:55:25 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf, portal: 172.16.0.220,3260] successful.
Nov 15 12:55:25 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fdcbc2-5753-4c43-b7e8-42de149223b7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a61f72-0412-4410-9db6-6cb9832e5944]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf (non-flash)
Nov 15 12:55:25 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:55:25 user nova-compute[75813]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf (non-flash)
Nov 15 12:55:25 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff0d000-dcf5-4793-b208-002cfd687e2d]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:55:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuTVhvdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:55:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:55:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23937303239393939', 'path': '/dev/sdf'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:55:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937303239393939', 'path': '/dev/sdf'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:55:26 user nova-compute[75813]: DEBUG nova.objects.instance [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:55:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:55:26 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:55:26 user nova-compute[75813]:   <source dev="/dev/sdf"/>
Nov 15 12:55:26 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:55:26 user nova-compute[75813]:   <serial>f634465f-22b4-4b24-b2ad-a73b34800faf</serial>
Nov 15 12:55:26 user nova-compute[75813]: </disk>
Nov 15 12:55:26 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:55:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:55:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:55:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No VIF found with MAC fa:16:3e:a5:07:30, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:55:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caaf4553-5fb7-47dd-baa2-808818161319 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.882s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:29 user nova-compute[75813]: INFO nova.compute.manager [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Detaching volume f634465f-22b4-4b24-b2ad-a73b34800faf
Nov 15 12:55:29 user nova-compute[75813]: INFO nova.virt.block_device [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attempting to driver detach volume f634465f-22b4-4b24-b2ad-a73b34800faf from mountpoint /dev/vdb
Nov 15 12:55:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Attempting to detach device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:55:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:55:29 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:55:29 user nova-compute[75813]:   <source dev="/dev/sdf"/>
Nov 15 12:55:29 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:55:29 user nova-compute[75813]:   <serial>f634465f-22b4-4b24-b2ad-a73b34800faf</serial>
Nov 15 12:55:29 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:55:29 user nova-compute[75813]: </disk>
Nov 15 12:55:29 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:55:29 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Successfully detached device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the persistent domain config.
Nov 15 12:55:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45154992-3213-43fa-89dc-d433f57ae978 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:55:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:55:29 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:55:29 user nova-compute[75813]:   <source dev="/dev/sdf"/>
Nov 15 12:55:29 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:55:29 user nova-compute[75813]:   <serial>f634465f-22b4-4b24-b2ad-a73b34800faf</serial>
Nov 15 12:55:29 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:55:29 user nova-compute[75813]: </disk>
Nov 15 12:55:29 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:55:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:55:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:31 user nova-compute[75813]: INFO nova.compute.manager [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Terminating instance
Nov 15 12:55:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-fc526d39-3921-43cc-a2c6-bbe1e4cafba1 req-bf9dee91-28b0-4482-84c8-1b64f8bae800 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-unplugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fc526d39-3921-43cc-a2c6-bbe1e4cafba1 req-bf9dee91-28b0-4482-84c8-1b64f8bae800 service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fc526d39-3921-43cc-a2c6-bbe1e4cafba1 req-bf9dee91-28b0-4482-84c8-1b64f8bae800 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fc526d39-3921-43cc-a2c6-bbe1e4cafba1 req-bf9dee91-28b0-4482-84c8-1b64f8bae800 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-fc526d39-3921-43cc-a2c6-bbe1e4cafba1 req-bf9dee91-28b0-4482-84c8-1b64f8bae800 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-unplugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-fc526d39-3921-43cc-a2c6-bbe1e4cafba1 req-bf9dee91-28b0-4482-84c8-1b64f8bae800 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-unplugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:31 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Instance destroyed successfully.
Nov 15 12:55:31 user nova-compute[75813]: DEBUG nova.objects.instance [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lazy-loading 'resources' on Instance uuid c15606eb-006c-4a2d-9f2b-a4cc69cc6f19 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T12:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1955156344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-993680613',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb/l5B2mNfvx3ejegALfCADApCPXkMgdnx4hiGlUk/k53ie1STpv9BkOk5dWVF/By6Oa+EXAiTFeu+O7HTaL+818YoX/tvMZolR8+GdK0FQFNb1pM3ypmccc7h/vvqoMQ==',key_name='tempest-keypair-1925599135',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73fd8b6a5e5b4b1a912b5292a82ab229',ramdisk_id='',reservation_id='r-1riwgsxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1768863154',owner_user_name='tempest-ServerActionsV293TestJSON-1768863154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:54:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5b1f2549c9478d8fb22044280d6e9e',uuid=c15606eb-006c-4a2d-9f2b-a4cc69cc6f19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converting VIF {"id": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "address": "fa:16:3e:d6:3f:4d", "network": {"id": "c5291a5a-468d-491d-8ee2-298dd1030f5b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1011046362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73fd8b6a5e5b4b1a912b5292a82ab229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b9b70a-52", "ovs_interfaceid": "c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:55:31 user nova-compute[75813]: DEBUG os_vif [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4b9b70a-52, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29fe1147-fdf4-4591-aee3-cf0ce0dbd5b7) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: INFO os_vif [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:3f:4d,bridge_name='br-int',has_traffic_filtering=True,id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe,network=Network(c5291a5a-468d-491d-8ee2-298dd1030f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b9b70a-52')
Nov 15 12:55:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjbkhYZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:55:32 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4402c4d1-b9b6-44e6-a5c2-1f84753d1d84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:55:32 user nova-compute[75813]: No targets found.
Nov 15 12:55:32 user nova-compute[75813]: iSNS:
Nov 15 12:55:32 user nova-compute[75813]: No targets found.
Nov 15 12:55:32 user nova-compute[75813]: STATIC:
Nov 15 12:55:32 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837
Nov 15 12:55:32 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:32 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:32 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62
Nov 15 12:55:32 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:32 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:32 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09
Nov 15 12:55:32 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:32 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:32 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:55:32 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:32 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:32 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606
Nov 15 12:55:32 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:32 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:32 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf
Nov 15 12:55:32 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:32 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:32 user nova-compute[75813]: FIRMWARE:
Nov 15 12:55:32 user nova-compute[75813]: No targets found.
Nov 15 12:55:32 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:55:32 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:55:32 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30becf9-52bc-4e6b-9319-64fe5b2ecb35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea098290-0d33-4efb-b41d-086ec315f265]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:55:32 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:55:32 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:55:32 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:55:32 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:55:32 user nova-compute[75813]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf (non-flash)
Nov 15 12:55:32 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:55:32 user nova-compute[75813]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 (non-flash)
Nov 15 12:55:32 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:55:32 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:55:32 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:55:32 user nova-compute[75813]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf (non-flash)
Nov 15 12:55:32 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55306097e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62'): ({'sdc'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Removing single pathed devices sdc {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[db98d7fa-6570-4c4c-b0a9-20402bc442bc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.035s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad285a0-0a30-48fc-9a44-7f62c078240a]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Flushing IO for device /dev/sdc {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1cbdcb-2132-4ecd-a1ec-27b01e8e090a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc5d014-745f-41b3-b637-526a641763a1]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[52004d1a-a5a7-4938-a6ad-ccede076127d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[897c2f17-1ce6-42f9-9ed9-af5f3f693575]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260]
Nov 15 12:55:32 user nova-compute[75813]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62, portal: 172.16.0.220,3260] successful.
Nov 15 12:55:32 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25d20-b388-4c9f-9936-ba1f29755c62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.074s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bccc906-794f-477b-aeb2-31869c089242]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] <== disconnect_volume: return (431ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:55:32 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Deleting instance files /opt/stack/data/nova/instances/c15606eb-006c-4a2d-9f2b-a4cc69cc6f19_del
Nov 15 12:55:32 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Deletion of /opt/stack/data/nova/instances/c15606eb-006c-4a2d-9f2b-a4cc69cc6f19_del complete
Nov 15 12:55:32 user nova-compute[75813]: INFO nova.compute.manager [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 15 12:55:32 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-13de0d1d-25ae-4a30-ab23-55e417b4f53b req-f581b3f0-70af-4153-85ae-d3e06a227063 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-deleted-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:33 user nova-compute[75813]: INFO nova.compute.manager [req-13de0d1d-25ae-4a30-ab23-55e417b4f53b req-f581b3f0-70af-4153-85ae-d3e06a227063 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Neutron deleted interface c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe; detaching it from the instance and deleting it from the info cache
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.network.neutron [req-13de0d1d-25ae-4a30-ab23-55e417b4f53b req-f581b3f0-70af-4153-85ae-d3e06a227063 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:55:33 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Took 0.74 seconds to deallocate network for instance.
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-13de0d1d-25ae-4a30-ab23-55e417b4f53b req-f581b3f0-70af-4153-85ae-d3e06a227063 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Detach interface failed, port_id=c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe, reason: Instance c15606eb-006c-4a2d-9f2b-a4cc69cc6f19 could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:33 user nova-compute[75813]: WARNING nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received unexpected event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with vm_state active and task_state deleting.
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:33 user nova-compute[75813]: WARNING nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received unexpected event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with vm_state active and task_state deleting.
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:33 user nova-compute[75813]: WARNING nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received unexpected event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with vm_state active and task_state deleting.
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-unplugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-unplugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-unplugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Acquiring lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] No waiting events found dispatching network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:33 user nova-compute[75813]: WARNING nova.compute.manager [req-075355fe-9a5b-4bf0-988d-30a79113e07f req-99c0a907-4a9b-42d6-b328-9a93e84e7142 service nova] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Received unexpected event network-vif-plugged-c4b9b70a-52c0-426c-8ec5-992b0d2cdfbe for instance with vm_state active and task_state deleting.
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "9693ad51-4044-46be-a5dc-00db9bf198bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:55:33 user nova-compute[75813]: INFO nova.compute.claims [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Claim successful on node user
Nov 15 12:55:34 user nova-compute[75813]: INFO nova.compute.manager [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Took 0.81 seconds to detach 1 volumes for instance.
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] [instance: c15606eb-006c-4a2d-9f2b-a4cc69cc6f19] Deleting volume: ced25d20-b388-4c9f-9936-ba1f29755c62 {{(pid=75813) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.081s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.network.neutron [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:55:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.policy [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fa6040843394b2fa38e29ff70e9d3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221ec165127e467a9131e2ff691429b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:55:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Creating image(s)
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "/opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "/opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "/opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:34 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Deleted allocations for instance c15606eb-006c-4a2d-9f2b-a4cc69cc6f19
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-629e4921-f556-4bd5-982d-3b3286daa11b tempest-ServerActionsV293TestJSON-1768863154 tempest-ServerActionsV293TestJSON-1768863154-project-member] Lock "c15606eb-006c-4a2d-9f2b-a4cc69cc6f19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.675s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk 1073741824" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG nova.network.neutron [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Successfully created port: 0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Cannot resize image /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Ensure instance console log exists: /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG nova.network.neutron [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Successfully updated port: 0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "refresh_cache-9693ad51-4044-46be-a5dc-00db9bf198bb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquired lock "refresh_cache-9693ad51-4044-46be-a5dc-00db9bf198bb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG nova.network.neutron [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-79383851-a590-4b9e-a5fe-9106bb17683a req-b35e4efb-4778-43e7-99c1-5aa2c7d1120f service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received event network-changed-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-79383851-a590-4b9e-a5fe-9106bb17683a req-b35e4efb-4778-43e7-99c1-5aa2c7d1120f service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Refreshing instance network info cache due to event network-changed-0c275c19-2b0e-462b-a9ee-e953d881ce51. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-79383851-a590-4b9e-a5fe-9106bb17683a req-b35e4efb-4778-43e7-99c1-5aa2c7d1120f service nova] Acquiring lock "refresh_cache-9693ad51-4044-46be-a5dc-00db9bf198bb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:55:35 user nova-compute[75813]: DEBUG nova.network.neutron [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.network.neutron [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Updating instance_info_cache with network_info: [{"id": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "address": "fa:16:3e:e7:5b:70", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c275c19-2b", "ovs_interfaceid": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Releasing lock "refresh_cache-9693ad51-4044-46be-a5dc-00db9bf198bb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.compute.manager [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Instance network_info: |[{"id": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "address": "fa:16:3e:e7:5b:70", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c275c19-2b", "ovs_interfaceid": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-79383851-a590-4b9e-a5fe-9106bb17683a req-b35e4efb-4778-43e7-99c1-5aa2c7d1120f service nova] Acquired lock "refresh_cache-9693ad51-4044-46be-a5dc-00db9bf198bb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.network.neutron [req-79383851-a590-4b9e-a5fe-9106bb17683a req-b35e4efb-4778-43e7-99c1-5aa2c7d1120f service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Refreshing network info cache for port 0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Start _get_guest_xml network_info=[{"id": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "address": "fa:16:3e:e7:5b:70", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c275c19-2b", "ovs_interfaceid": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:55:36 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:55:36 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:55:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-81108389',display_name='tempest-VolumesAdminNegativeTest-server-81108389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-81108389',id=19,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='221ec165127e467a9131e2ff691429b1',ramdisk_id='',reservation_id='r-q831ivz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1498772195',owner_user_name='tempest-VolumesAdminNegativeTest-1498772195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:55:34Z,user_data=None,user_id='9fa6040843394b2fa38e29ff70e9d3ed',uuid=9693ad51-4044-46be-a5dc-00db9bf198bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "address": "fa:16:3e:e7:5b:70", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c275c19-2b", "ovs_interfaceid": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converting VIF {"id": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "address": "fa:16:3e:e7:5b:70", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c275c19-2b", "ovs_interfaceid": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5b:70,bridge_name='br-int',has_traffic_filtering=True,id=0c275c19-2b0e-462b-a9ee-e953d881ce51,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c275c19-2b') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.objects.instance [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lazy-loading 'pci_devices' on Instance uuid 9693ad51-4044-46be-a5dc-00db9bf198bb {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:55:36 user nova-compute[75813]:   <uuid>9693ad51-4044-46be-a5dc-00db9bf198bb</uuid>
Nov 15 12:55:36 user nova-compute[75813]:   <name>instance-00000013</name>
Nov 15 12:55:36 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:55:36 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:55:36 user nova-compute[75813]:   <metadata>
Nov 15 12:55:36 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:55:36 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:55:36 user nova-compute[75813]:       <nova:name>tempest-VolumesAdminNegativeTest-server-81108389</nova:name>
Nov 15 12:55:36 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:55:36</nova:creationTime>
Nov 15 12:55:36 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:55:36 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:55:36 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:55:36 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:55:36 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:55:36 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:55:36 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:55:36 user nova-compute[75813]:       <nova:owner>
Nov 15 12:55:36 user nova-compute[75813]:         <nova:user uuid="9fa6040843394b2fa38e29ff70e9d3ed">tempest-VolumesAdminNegativeTest-1498772195-project-member</nova:user>
Nov 15 12:55:36 user nova-compute[75813]:         <nova:project uuid="221ec165127e467a9131e2ff691429b1">tempest-VolumesAdminNegativeTest-1498772195</nova:project>
Nov 15 12:55:36 user nova-compute[75813]:       </nova:owner>
Nov 15 12:55:36 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:55:36 user nova-compute[75813]:       <nova:ports>
Nov 15 12:55:36 user nova-compute[75813]:         <nova:port uuid="0c275c19-2b0e-462b-a9ee-e953d881ce51">
Nov 15 12:55:36 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 12:55:36 user nova-compute[75813]:         </nova:port>
Nov 15 12:55:36 user nova-compute[75813]:       </nova:ports>
Nov 15 12:55:36 user nova-compute[75813]:     </nova:instance>
Nov 15 12:55:36 user nova-compute[75813]:   </metadata>
Nov 15 12:55:36 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:55:36 user nova-compute[75813]:     <system>
Nov 15 12:55:36 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:55:36 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:55:36 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:55:36 user nova-compute[75813]:       <entry name="serial">9693ad51-4044-46be-a5dc-00db9bf198bb</entry>
Nov 15 12:55:36 user nova-compute[75813]:       <entry name="uuid">9693ad51-4044-46be-a5dc-00db9bf198bb</entry>
Nov 15 12:55:36 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:55:36 user nova-compute[75813]:     </system>
Nov 15 12:55:36 user nova-compute[75813]:   </sysinfo>
Nov 15 12:55:36 user nova-compute[75813]:   <os>
Nov 15 12:55:36 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:55:36 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:55:36 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:55:36 user nova-compute[75813]:   </os>
Nov 15 12:55:36 user nova-compute[75813]:   <features>
Nov 15 12:55:36 user nova-compute[75813]:     <acpi/>
Nov 15 12:55:36 user nova-compute[75813]:     <apic/>
Nov 15 12:55:36 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:55:36 user nova-compute[75813]:   </features>
Nov 15 12:55:36 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:55:36 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:55:36 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:55:36 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:55:36 user nova-compute[75813]:   </clock>
Nov 15 12:55:36 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:55:36 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:55:36 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:55:36 user nova-compute[75813]:   </cpu>
Nov 15 12:55:36 user nova-compute[75813]:   <devices>
Nov 15 12:55:36 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:55:36 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:55:36 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk"/>
Nov 15 12:55:36 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:55:36 user nova-compute[75813]:     </disk>
Nov 15 12:55:36 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:55:36 user nova-compute[75813]:       <mac address="fa:16:3e:e7:5b:70"/>
Nov 15 12:55:36 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:55:36 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:55:36 user nova-compute[75813]:       <target dev="tap0c275c19-2b"/>
Nov 15 12:55:36 user nova-compute[75813]:     </interface>
Nov 15 12:55:36 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:55:36 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/console.log" append="off"/>
Nov 15 12:55:36 user nova-compute[75813]:     </serial>
Nov 15 12:55:36 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:55:36 user nova-compute[75813]:     <video>
Nov 15 12:55:36 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:55:36 user nova-compute[75813]:     </video>
Nov 15 12:55:36 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:55:36 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:55:36 user nova-compute[75813]:     </rng>
Nov 15 12:55:36 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:55:36 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:55:36 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:55:36 user nova-compute[75813]:     </memballoon>
Nov 15 12:55:36 user nova-compute[75813]:   </devices>
Nov 15 12:55:36 user nova-compute[75813]: </domain>
Nov 15 12:55:36 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:55:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-81108389',display_name='tempest-VolumesAdminNegativeTest-server-81108389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-81108389',id=19,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='221ec165127e467a9131e2ff691429b1',ramdisk_id='',reservation_id='r-q831ivz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1498772195',owner_user_name='tempest-VolumesAdminNegativeTest-1498772195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:55:34Z,user_data=None,user_id='9fa6040843394b2fa38e29ff70e9d3ed',uuid=9693ad51-4044-46be-a5dc-00db9bf198bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "address": "fa:16:3e:e7:5b:70", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c275c19-2b", "ovs_interfaceid": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converting VIF {"id": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "address": "fa:16:3e:e7:5b:70", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c275c19-2b", "ovs_interfaceid": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5b:70,bridge_name='br-int',has_traffic_filtering=True,id=0c275c19-2b0e-462b-a9ee-e953d881ce51,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c275c19-2b') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG os_vif [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5b:70,bridge_name='br-int',has_traffic_filtering=True,id=0c275c19-2b0e-462b-a9ee-e953d881ce51,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c275c19-2b') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e57a289d-39c6-56a3-b0ab-3e2a9ad493d7', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c275c19-2b, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c275c19-2b, col_values=(('qos', UUID('63926f5a-2f95-468f-8356-ba99f3814d95')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c275c19-2b, col_values=(('external_ids', {'iface-id': '0c275c19-2b0e-462b-a9ee-e953d881ce51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:5b:70', 'vm-uuid': '9693ad51-4044-46be-a5dc-00db9bf198bb'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:36 user nova-compute[75813]: INFO os_vif [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5b:70,bridge_name='br-int',has_traffic_filtering=True,id=0c275c19-2b0e-462b-a9ee-e953d881ce51,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c275c19-2b')
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] No VIF found with MAC fa:16:3e:e7:5b:70, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.network.neutron [req-79383851-a590-4b9e-a5fe-9106bb17683a req-b35e4efb-4778-43e7-99c1-5aa2c7d1120f service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Updated VIF entry in instance network info cache for port 0c275c19-2b0e-462b-a9ee-e953d881ce51. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG nova.network.neutron [req-79383851-a590-4b9e-a5fe-9106bb17683a req-b35e4efb-4778-43e7-99c1-5aa2c7d1120f service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Updating instance_info_cache with network_info: [{"id": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "address": "fa:16:3e:e7:5b:70", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c275c19-2b", "ovs_interfaceid": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:55:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-79383851-a590-4b9e-a5fe-9106bb17683a req-b35e4efb-4778-43e7-99c1-5aa2c7d1120f service nova] Releasing lock "refresh_cache-9693ad51-4044-46be-a5dc-00db9bf198bb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:55:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-0d832d77-f2e5-4bf4-8782-d88c5df487bd req-98a169c6-99f5-450b-af78-c83fd0b92173 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0d832d77-f2e5-4bf4-8782-d88c5df487bd req-98a169c6-99f5-450b-af78-c83fd0b92173 service nova] Acquiring lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0d832d77-f2e5-4bf4-8782-d88c5df487bd req-98a169c6-99f5-450b-af78-c83fd0b92173 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0d832d77-f2e5-4bf4-8782-d88c5df487bd req-98a169c6-99f5-450b-af78-c83fd0b92173 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-0d832d77-f2e5-4bf4-8782-d88c5df487bd req-98a169c6-99f5-450b-af78-c83fd0b92173 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] No waiting events found dispatching network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:38 user nova-compute[75813]: WARNING nova.compute.manager [req-0d832d77-f2e5-4bf4-8782-d88c5df487bd req-98a169c6-99f5-450b-af78-c83fd0b92173 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received unexpected event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 for instance with vm_state building and task_state spawning.
Nov 15 12:55:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:55:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Instance spawned successfully.
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-548100d9-2c2f-4abd-a1b8-11810bf4ff8e req-c95a9721-f8c2-4f72-ad53-c4057cc1eaa1 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-548100d9-2c2f-4abd-a1b8-11810bf4ff8e req-c95a9721-f8c2-4f72-ad53-c4057cc1eaa1 service nova] Acquiring lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-548100d9-2c2f-4abd-a1b8-11810bf4ff8e req-c95a9721-f8c2-4f72-ad53-c4057cc1eaa1 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-548100d9-2c2f-4abd-a1b8-11810bf4ff8e req-c95a9721-f8c2-4f72-ad53-c4057cc1eaa1 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-548100d9-2c2f-4abd-a1b8-11810bf4ff8e req-c95a9721-f8c2-4f72-ad53-c4057cc1eaa1 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] No waiting events found dispatching network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:40 user nova-compute[75813]: WARNING nova.compute.manager [req-548100d9-2c2f-4abd-a1b8-11810bf4ff8e req-c95a9721-f8c2-4f72-ad53-c4057cc1eaa1 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received unexpected event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 for instance with vm_state building and task_state spawning.
Nov 15 12:55:40 user nova-compute[75813]: INFO nova.compute.manager [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 15 12:55:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:55:40 user nova-compute[75813]: INFO nova.compute.manager [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Took 6.48 seconds to build instance.
Nov 15 12:55:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-70f445b3-bbbb-4ecc-a608-dc94a18b3b6e tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.588s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updating instance_info_cache with network_info: [{"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:55:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:55:44 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:48 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:55:48 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7915MB free_disk=25.38425064086914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 870cf760-ae0c-4df1-99cf-6403d8e642ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 36b32262-4ea0-4a33-9672-82c7b8061bb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 45154992-3213-43fa-89dc-d433f57ae978 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4bf92268-8acd-4092-94ed-3ae2b85b4f8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 794722de-e692-49f8-8bc9-ff64854ec405 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 9693ad51-4044-46be-a5dc-00db9bf198bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:55:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:49 user nova-compute[75813]: INFO nova.compute.manager [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Terminating instance
Nov 15 12:55:49 user nova-compute[75813]: DEBUG nova.compute.manager [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-d834b876-10e7-448e-9130-188e207c3e51 req-24c2df8c-1416-4e14-8b23-1450fa9ce0fd service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-vif-unplugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d834b876-10e7-448e-9130-188e207c3e51 req-24c2df8c-1416-4e14-8b23-1450fa9ce0fd service nova] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d834b876-10e7-448e-9130-188e207c3e51 req-24c2df8c-1416-4e14-8b23-1450fa9ce0fd service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d834b876-10e7-448e-9130-188e207c3e51 req-24c2df8c-1416-4e14-8b23-1450fa9ce0fd service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-d834b876-10e7-448e-9130-188e207c3e51 req-24c2df8c-1416-4e14-8b23-1450fa9ce0fd service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] No waiting events found dispatching network-vif-unplugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-d834b876-10e7-448e-9130-188e207c3e51 req-24c2df8c-1416-4e14-8b23-1450fa9ce0fd service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-vif-unplugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Instance destroyed successfully.
Nov 15 12:55:49 user nova-compute[75813]: DEBUG nova.objects.instance [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lazy-loading 'resources' on Instance uuid 868f2db9-e52c-4f9a-8bd3-18ec6807377e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211354557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211354557',id=15,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy1dLT3BMBPj0HMd2wO6SlIfeOmZ5zLbEAioS6Myt1UETKqLiMh/MFli0JtJDPjUkaSiV8utv6xgh1ZfE1PdfxOgyxPJzAm7dYkPDYpHgRwmjqP16hyPEVizDOZD284gw==',key_name='tempest-keypair-1348731404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce97b303bdb940c59d6cea5ad91ef0d4',ramdisk_id='',reservation_id='r-mq0pxr7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179121499',owner_user_name='tempest-TaggedAttachmentsTest-1179121499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74615b8601894772b20328f7b894c9a1',uuid=868f2db9-e52c-4f9a-8bd3-18ec6807377e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converting VIF {"id": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "address": "fa:16:3e:e0:6d:60", "network": {"id": "939963f6-20b9-4559-b0db-8b37b974e899", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1266909064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce97b303bdb940c59d6cea5ad91ef0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637149a0-24", "ovs_interfaceid": "637149a0-24b9-4fed-8cc4-6dd3a909c874", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=637149a0-24b9-4fed-8cc4-6dd3a909c874,network=Network(939963f6-20b9-4559-b0db-8b37b974e899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637149a0-24') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG os_vif [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=637149a0-24b9-4fed-8cc4-6dd3a909c874,network=Network(939963f6-20b9-4559-b0db-8b37b974e899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637149a0-24') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap637149a0-24, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e11c97b-cbd5-4bb2-8ca1-cab1ac45bc9b) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:49 user nova-compute[75813]: INFO os_vif [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:6d:60,bridge_name='br-int',has_traffic_filtering=True,id=637149a0-24b9-4fed-8cc4-6dd3a909c874,network=Network(939963f6-20b9-4559-b0db-8b37b974e899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637149a0-24')
Nov 15 12:55:49 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Deleting instance files /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e_del
Nov 15 12:55:49 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Deletion of /opt/stack/data/nova/instances/868f2db9-e52c-4f9a-8bd3-18ec6807377e_del complete
Nov 15 12:55:49 user nova-compute[75813]: INFO nova.compute.manager [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 12:55:49 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:55:49 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:55:50 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45154992-3213-43fa-89dc-d433f57ae978 is timed out.
Nov 15 12:55:50 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Successfully detached device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the live domain config.
Nov 15 12:55:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuTVhvdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:55:50 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0db9a9-ff58-4a65-a06d-578fc3f672e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:55:50 user nova-compute[75813]: No targets found.
Nov 15 12:55:50 user nova-compute[75813]: iSNS:
Nov 15 12:55:50 user nova-compute[75813]: No targets found.
Nov 15 12:55:50 user nova-compute[75813]: STATIC:
Nov 15 12:55:50 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837
Nov 15 12:55:50 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:50 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:50 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09
Nov 15 12:55:50 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:50 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:50 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:55:50 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:50 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:50 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606
Nov 15 12:55:50 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:50 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:50 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf
Nov 15 12:55:50 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:55:50 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:55:50 user nova-compute[75813]: FIRMWARE:
Nov 15 12:55:50 user nova-compute[75813]: No targets found.
Nov 15 12:55:50 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:55:50 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:55:50 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cd8626-0a16-41b8-80f4-61057e87f1fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[485b2c99-267f-4fc6-882a-556dcac22d15]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:55:50 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:55:50 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:55:50 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:55:50 user nova-compute[75813]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf (non-flash)
Nov 15 12:55:50 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:55:50 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:55:50 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:55:50 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:55:50 user nova-compute[75813]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf (non-flash)
Nov 15 12:55:50 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5530766d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf'): ({'sdf'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Removing single pathed devices sdf {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[832fb014-3753-4248-a61c-3af16909b15c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[168eca45-f97b-440c-b230-c777e91d2cfa]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Flushing IO for device /dev/sdf {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc55f027-c667-4d83-8782-7b2680efa5cf]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba2b125-59f2-40e4-b2ec-87dcc9ddc29e]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab609ae-7f8a-4c94-ac1b-f3758de1ac3b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:55:50 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Took 0.72 seconds to deallocate network for instance.
Nov 15 12:55:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-930bdd68-5bc6-4a43-8029-ef19fb0dadb7 req-5e16df58-60e5-40b5-b5fb-a8d242a0cedc service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-vif-deleted-637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb881a53-2669-41bb-918b-c88dd0fde13e]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf, portal: 172.16.0.220,3260]
Nov 15 12:55:50 user nova-compute[75813]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf, portal: 172.16.0.220,3260] successful.
Nov 15 12:55:50 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f634465f-22b4-4b24-b2ad-a73b34800faf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ae72eb-53a0-4f2b-9a84-40a3276ec104]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== disconnect_volume: return (347ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:55:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:51 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Deleted allocations for instance 868f2db9-e52c-4f9a-8bd3-18ec6807377e
Nov 15 12:55:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce57ba4b-860a-4d11-bfaa-2bb7bc07d04f tempest-TaggedAttachmentsTest-1179121499 tempest-TaggedAttachmentsTest-1179121499-project-member] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.068s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-da8f70a1-f97d-48d8-a497-175d5202c074 req-58878f37-53a9-458f-9a04-8224276e257d service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received event network-vif-plugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:55:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-da8f70a1-f97d-48d8-a497-175d5202c074 req-58878f37-53a9-458f-9a04-8224276e257d service nova] Acquiring lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:55:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-da8f70a1-f97d-48d8-a497-175d5202c074 req-58878f37-53a9-458f-9a04-8224276e257d service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:55:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-da8f70a1-f97d-48d8-a497-175d5202c074 req-58878f37-53a9-458f-9a04-8224276e257d service nova] Lock "868f2db9-e52c-4f9a-8bd3-18ec6807377e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-da8f70a1-f97d-48d8-a497-175d5202c074 req-58878f37-53a9-458f-9a04-8224276e257d service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] No waiting events found dispatching network-vif-plugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:55:51 user nova-compute[75813]: WARNING nova.compute.manager [req-da8f70a1-f97d-48d8-a497-175d5202c074 req-58878f37-53a9-458f-9a04-8224276e257d service nova] [instance: 868f2db9-e52c-4f9a-8bd3-18ec6807377e] Received unexpected event network-vif-plugged-637149a0-24b9-4fed-8cc4-6dd3a909c874 for instance with vm_state deleted and task_state None.
Nov 15 12:55:51 user nova-compute[75813]: DEBUG nova.objects.instance [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:55:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ac901d28-6062-448b-bdd4-d720cc61da3b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.841s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:55:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:55:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-e9c43214-8d01-4be3-830f-2c8d3b07beee req-761930c5-efce-40c0-990e-4eb4ba34d604 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Received event network-changed-d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-e9c43214-8d01-4be3-830f-2c8d3b07beee req-761930c5-efce-40c0-990e-4eb4ba34d604 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Refreshing instance network info cache due to event network-changed-d6630471-bf54-4db0-9251-07ae85b91335. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:56:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e9c43214-8d01-4be3-830f-2c8d3b07beee req-761930c5-efce-40c0-990e-4eb4ba34d604 service nova] Acquiring lock "refresh_cache-4bf92268-8acd-4092-94ed-3ae2b85b4f8e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:56:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e9c43214-8d01-4be3-830f-2c8d3b07beee req-761930c5-efce-40c0-990e-4eb4ba34d604 service nova] Acquired lock "refresh_cache-4bf92268-8acd-4092-94ed-3ae2b85b4f8e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:56:05 user nova-compute[75813]: DEBUG nova.network.neutron [req-e9c43214-8d01-4be3-830f-2c8d3b07beee req-761930c5-efce-40c0-990e-4eb4ba34d604 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Refreshing network info cache for port d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:56:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:05 user nova-compute[75813]: DEBUG nova.network.neutron [req-e9c43214-8d01-4be3-830f-2c8d3b07beee req-761930c5-efce-40c0-990e-4eb4ba34d604 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Updated VIF entry in instance network info cache for port d6630471-bf54-4db0-9251-07ae85b91335. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:56:05 user nova-compute[75813]: DEBUG nova.network.neutron [req-e9c43214-8d01-4be3-830f-2c8d3b07beee req-761930c5-efce-40c0-990e-4eb4ba34d604 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Updating instance_info_cache with network_info: [{"id": "d6630471-bf54-4db0-9251-07ae85b91335", "address": "fa:16:3e:c4:36:59", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6630471-bf", "ovs_interfaceid": "d6630471-bf54-4db0-9251-07ae85b91335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:56:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e9c43214-8d01-4be3-830f-2c8d3b07beee req-761930c5-efce-40c0-990e-4eb4ba34d604 service nova] Releasing lock "refresh_cache-4bf92268-8acd-4092-94ed-3ae2b85b4f8e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:56:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:06 user nova-compute[75813]: DEBUG nova.objects.instance [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'flavor' on Instance uuid 4bf92268-8acd-4092-94ed-3ae2b85b4f8e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:56:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:07 user nova-compute[75813]: INFO nova.compute.manager [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Attaching volume 75f8a6ad-fc40-4652-8763-67638a68745b to /dev/vdb
Nov 15 12:56:07 user nova-compute[75813]: DEBUG os_brick.utils [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8237707-0a10-45c9-979a-b2effac3bda8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0549d5b-6f1e-4037-bc77-12f121109f54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb4e317-f472-4e09-a030-921a9e14d071]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9008cce4-215d-4022-9b66-7936f0184463]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:56:07 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:56:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0e60ff-36e2-4072-984b-04fefad8253b]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG os_brick.utils [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:07 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Updating existing volume attachment record: ca39a255-14c4-44d7-b722-87f6ff6b8e4f {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:56:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOIhuTvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:11 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:11 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:11 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac95d96f-963e-45c8-80a1-c693d00370ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:56:11 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[edba1904-110e-443c-ac3a-3f83ed68a360]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b] added
Nov 15 12:56:11 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17841e9-61b2-4eb1-9700-53e1592dde92]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.064s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e80494-0622-49fa-8b04-5f6eb211a47c]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOIhuTvJ {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOIhuTvJ" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[030cb9bf-e6e3-434c-a425-bb7b1e06c9ad]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yOIhuTvJ'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7babc734-8f9b-4bdd-b72b-052d114fc013]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[14377271-123e-42fd-ba49-ddd0968ac9af]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc4f8ee-b988-469f-b595-c23b5663f235]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b, portal: 172.16.0.220,3260]
Nov 15 12:56:12 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b, portal: 172.16.0.220,3260] successful.
Nov 15 12:56:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[880b7aa8-dece-4c37-859a-79a146a67a41]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fda764-9f7c-4bea-92cf-e86ddadd540d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:12 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4594b3a3-75cc-4983-af8b-58a53e4ee8cd]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:56:13 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:56:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOIhuTvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:56:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23639613938656237', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639613938656237', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:56:13 user nova-compute[75813]: DEBUG nova.objects.instance [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'flavor' on Instance uuid 4bf92268-8acd-4092-94ed-3ae2b85b4f8e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:56:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:56:13 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:56:13 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 12:56:13 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:56:13 user nova-compute[75813]:   <serial>75f8a6ad-fc40-4652-8763-67638a68745b</serial>
Nov 15 12:56:13 user nova-compute[75813]: </disk>
Nov 15 12:56:13 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:56:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:56:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:56:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No VIF found with MAC fa:16:3e:c4:36:59, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:56:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-44578b3c-d845-4d38-965a-800c18f4005d tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.689s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "870cf760-ae0c-4df1-99cf-6403d8e642ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:14 user nova-compute[75813]: INFO nova.compute.manager [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Terminating instance
Nov 15 12:56:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-d12f7d5b-c738-46ae-b507-1d85ace91a75 req-babc9db1-23dc-4fea-884a-1c494c1564e9 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Received event network-vif-unplugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d12f7d5b-c738-46ae-b507-1d85ace91a75 req-babc9db1-23dc-4fea-884a-1c494c1564e9 service nova] Acquiring lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d12f7d5b-c738-46ae-b507-1d85ace91a75 req-babc9db1-23dc-4fea-884a-1c494c1564e9 service nova] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d12f7d5b-c738-46ae-b507-1d85ace91a75 req-babc9db1-23dc-4fea-884a-1c494c1564e9 service nova] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-d12f7d5b-c738-46ae-b507-1d85ace91a75 req-babc9db1-23dc-4fea-884a-1c494c1564e9 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] No waiting events found dispatching network-vif-unplugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-d12f7d5b-c738-46ae-b507-1d85ace91a75 req-babc9db1-23dc-4fea-884a-1c494c1564e9 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Received event network-vif-unplugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:14 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Instance destroyed successfully.
Nov 15 12:56:14 user nova-compute[75813]: DEBUG nova.objects.instance [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lazy-loading 'resources' on Instance uuid 870cf760-ae0c-4df1-99cf-6403d8e642ce {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-986294058',display_name='tempest-ServersNegativeTestJSON-server-986294058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-986294058',id=1,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:47:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abb93fcbc60e4efbb8d3bb0c657f1b64',ramdisk_id='',reservation_id='r-6vtu6bez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-880603076',owner_user_name='tempest-ServersNegativeTestJSON-880603076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:47:52Z,user_data=None,user_id='46c14d0607324e6ba1e447b5f5945a99',uuid=870cf760-ae0c-4df1-99cf-6403d8e642ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converting VIF {"id": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "address": "fa:16:3e:23:8c:02", "network": {"id": "86c88536-790b-49d6-8167-e6cd265ada0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-817896740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abb93fcbc60e4efbb8d3bb0c657f1b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460a944c-a9", "ovs_interfaceid": "460a944c-a9e9-43e9-9a0a-c071cbf471e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:8c:02,bridge_name='br-int',has_traffic_filtering=True,id=460a944c-a9e9-43e9-9a0a-c071cbf471e4,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460a944c-a9') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG os_vif [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:8c:02,bridge_name='br-int',has_traffic_filtering=True,id=460a944c-a9e9-43e9-9a0a-c071cbf471e4,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460a944c-a9') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap460a944c-a9, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98b78259-bca0-4903-bec2-633393062aa7) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:14 user nova-compute[75813]: INFO os_vif [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:8c:02,bridge_name='br-int',has_traffic_filtering=True,id=460a944c-a9e9-43e9-9a0a-c071cbf471e4,network=Network(86c88536-790b-49d6-8167-e6cd265ada0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460a944c-a9')
Nov 15 12:56:14 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Deleting instance files /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce_del
Nov 15 12:56:14 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Deletion of /opt/stack/data/nova/instances/870cf760-ae0c-4df1-99cf-6403d8e642ce_del complete
Nov 15 12:56:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:15 user nova-compute[75813]: INFO nova.compute.manager [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 15 12:56:15 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:56:15 user nova-compute[75813]: INFO nova.compute.manager [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Detaching volume 75f8a6ad-fc40-4652-8763-67638a68745b
Nov 15 12:56:15 user nova-compute[75813]: INFO nova.virt.block_device [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Attempting to driver detach volume 75f8a6ad-fc40-4652-8763-67638a68745b from mountpoint /dev/vdb
Nov 15 12:56:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Attempting to detach device vdb from instance 4bf92268-8acd-4092-94ed-3ae2b85b4f8e from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:56:15 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:56:15 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 12:56:15 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:56:15 user nova-compute[75813]:   <serial>75f8a6ad-fc40-4652-8763-67638a68745b</serial>
Nov 15 12:56:15 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:56:15 user nova-compute[75813]: </disk>
Nov 15 12:56:15 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:56:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully detached device vdb from instance 4bf92268-8acd-4092-94ed-3ae2b85b4f8e from the persistent domain config.
Nov 15 12:56:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4bf92268-8acd-4092-94ed-3ae2b85b4f8e from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:56:15 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:56:15 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 12:56:15 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:56:15 user nova-compute[75813]:   <serial>75f8a6ad-fc40-4652-8763-67638a68745b</serial>
Nov 15 12:56:15 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:56:15 user nova-compute[75813]: </disk>
Nov 15 12:56:15 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:56:15 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Took 0.40 seconds to deallocate network for instance.
Nov 15 12:56:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4bf92268-8acd-4092-94ed-3ae2b85b4f8e {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:56:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:15 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Deleted allocations for instance 870cf760-ae0c-4df1-99cf-6403d8e642ce
Nov 15 12:56:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b5df4eac-cede-4e2b-95fc-40b3ef0a3468 tempest-ServersNegativeTestJSON-880603076 tempest-ServersNegativeTestJSON-880603076-project-member] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.792s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-e84161d2-123e-4c18-9304-d36dc6d91e37 req-35937a36-499b-409b-be7a-7d1b5126f955 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Received event network-vif-plugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e84161d2-123e-4c18-9304-d36dc6d91e37 req-35937a36-499b-409b-be7a-7d1b5126f955 service nova] Acquiring lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e84161d2-123e-4c18-9304-d36dc6d91e37 req-35937a36-499b-409b-be7a-7d1b5126f955 service nova] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e84161d2-123e-4c18-9304-d36dc6d91e37 req-35937a36-499b-409b-be7a-7d1b5126f955 service nova] Lock "870cf760-ae0c-4df1-99cf-6403d8e642ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-e84161d2-123e-4c18-9304-d36dc6d91e37 req-35937a36-499b-409b-be7a-7d1b5126f955 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] No waiting events found dispatching network-vif-plugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:16 user nova-compute[75813]: WARNING nova.compute.manager [req-e84161d2-123e-4c18-9304-d36dc6d91e37 req-35937a36-499b-409b-be7a-7d1b5126f955 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Received unexpected event network-vif-plugged-460a944c-a9e9-43e9-9a0a-c071cbf471e4 for instance with vm_state deleted and task_state None.
Nov 15 12:56:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-e84161d2-123e-4c18-9304-d36dc6d91e37 req-35937a36-499b-409b-be7a-7d1b5126f955 service nova] [instance: 870cf760-ae0c-4df1-99cf-6403d8e642ce] Received event network-vif-deleted-460a944c-a9e9-43e9-9a0a-c071cbf471e4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:20 user nova-compute[75813]: INFO nova.compute.manager [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Terminating instance
Nov 15 12:56:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-2c8b50e7-3726-45c7-aaa2-ac9e63e2e93a req-5e68a5ec-7336-4d2f-a401-fedc1227c5da service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-unplugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2c8b50e7-3726-45c7-aaa2-ac9e63e2e93a req-5e68a5ec-7336-4d2f-a401-fedc1227c5da service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2c8b50e7-3726-45c7-aaa2-ac9e63e2e93a req-5e68a5ec-7336-4d2f-a401-fedc1227c5da service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2c8b50e7-3726-45c7-aaa2-ac9e63e2e93a req-5e68a5ec-7336-4d2f-a401-fedc1227c5da service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-2c8b50e7-3726-45c7-aaa2-ac9e63e2e93a req-5e68a5ec-7336-4d2f-a401-fedc1227c5da service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-unplugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-2c8b50e7-3726-45c7-aaa2-ac9e63e2e93a req-5e68a5ec-7336-4d2f-a401-fedc1227c5da service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-unplugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:56:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Instance destroyed successfully.
Nov 15 12:56:21 user nova-compute[75813]: DEBUG nova.objects.instance [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lazy-loading 'resources' on Instance uuid 36b32262-4ea0-4a33-9672-82c7b8061bb1 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1881026575',display_name='tempest-ServerActionsTestOtherB-server-1881026575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1881026575',id=4,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnZCP66OrHRDZ3ufYGtTWYdbRBSuBJje4iccBj6qLgISdaiqkf+oj6TVWJiVhyyqw9aCzwVAnqyqjl+t9sQMq2PFBTOdf/G6orxxQMji4Jiz+kT9TtRhqkc6tVuBEXETA==',key_name='tempest-keypair-296274020',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:53:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e4af021f9f4272a0bf0f4f35e9d65a',ramdisk_id='',reservation_id='r-32pd9cde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1149556653',owner_user_name='tempest-ServerActionsTestOtherB-1149556653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfabcfa53a840b68e154b271703efe7',uuid=36b32262-4ea0-4a33-9672-82c7b8061bb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converting VIF {"id": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "address": "fa:16:3e:b7:0c:d8", "network": {"id": "634edba3-1938-42dc-9b14-370468b3c0a8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1897040021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e4af021f9f4272a0bf0f4f35e9d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4549cc-1d", "ovs_interfaceid": "1d4549cc-1d5a-4548-86d8-1832e8ce3d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_vif [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d4549cc-1d, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb93702b-b495-43e2-b391-f86c04e07437) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:21 user nova-compute[75813]: INFO os_vif [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:0c:d8,bridge_name='br-int',has_traffic_filtering=True,id=1d4549cc-1d5a-4548-86d8-1832e8ce3d4c,network=Network(634edba3-1938-42dc-9b14-370468b3c0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4549cc-1d')
Nov 15 12:56:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaXgiKyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:21 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f581f18a-5818-40aa-b235-74acbb94b5f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:56:21 user nova-compute[75813]: No targets found.
Nov 15 12:56:21 user nova-compute[75813]: iSNS:
Nov 15 12:56:21 user nova-compute[75813]: No targets found.
Nov 15 12:56:21 user nova-compute[75813]: STATIC:
Nov 15 12:56:21 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837
Nov 15 12:56:21 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:21 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:21 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b
Nov 15 12:56:21 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:21 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:21 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09
Nov 15 12:56:21 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:21 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:21 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda
Nov 15 12:56:21 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:21 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:21 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606
Nov 15 12:56:21 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:21 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:21 user nova-compute[75813]: FIRMWARE:
Nov 15 12:56:21 user nova-compute[75813]: No targets found.
Nov 15 12:56:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:56:21 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:56:21 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab62e1ff-0b6a-432b-8deb-d5debce8d2dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[43110331-c959-4ee1-8035-9c7a8d58ee82]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:56:21 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:21 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:21 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:21 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda (non-flash)
Nov 15 12:56:21 user nova-compute[75813]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:21 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:21 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:21 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5554bbf1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e22e2f0-420a-47c3-8ca7-cb9b52bf8b76]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2f3de0-290d-4b03-94b3-f40a1510b60b]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[817e3185-a457-4f7c-92e1-d95b8f8799ad]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e4c9a4-2984-4f2f-b36a-db6f3afe678f]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9633422c-6e57-4fdb-9dad-1b5710f0a579]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4f8464-8f3a-4b35-a019-84eaf0419525]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260]
Nov 15 12:56:21 user nova-compute[75813]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda, portal: 172.16.0.220,3260] successful.
Nov 15 12:56:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG nova.objects.instance [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddfa4c0-9f08-4124-b8b9-ee1ae1f20cda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e237636-7930-45cd-86aa-42cbcee4332a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] <== disconnect_volume: return (325ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:56:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Deleting instance files /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1_del
Nov 15 12:56:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Deletion of /opt/stack/data/nova/instances/36b32262-4ea0-4a33-9672-82c7b8061bb1_del complete
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:21 user nova-compute[75813]: INFO nova.compute.manager [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:21 user nova-compute[75813]: INFO nova.compute.manager [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attaching volume 33601776-11c1-4870-9d0d-075125e6bf47 to /dev/vdb
Nov 15 12:56:22 user nova-compute[75813]: DEBUG os_brick.utils [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7476ff5d-cec1-4a7f-8bbc-7a6d98f6d267]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8dadb8-1e2a-4d1a-bb43-62a2d3daa65f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2402a7-7c9f-45da-ad80-84a49447cb77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfb8232-6fb1-4718-9844-dc623f88ed23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:56:22 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e6437d-3885-4fec-913b-b99aac3662fa]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG os_brick.utils [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updating existing volume attachment record: 8cf798fa-60ba-4cbe-84b6-6964125b1231 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:56:22 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Took 0.88 seconds to deallocate network for instance.
Nov 15 12:56:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-413d7783-049e-44a5-ba20-6dd11d58cb0f req-9851a497-635d-44a9-813b-b3e21ef93b93 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-413d7783-049e-44a5-ba20-6dd11d58cb0f req-9851a497-635d-44a9-813b-b3e21ef93b93 service nova] Acquiring lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-413d7783-049e-44a5-ba20-6dd11d58cb0f req-9851a497-635d-44a9-813b-b3e21ef93b93 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-413d7783-049e-44a5-ba20-6dd11d58cb0f req-9851a497-635d-44a9-813b-b3e21ef93b93 service nova] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-413d7783-049e-44a5-ba20-6dd11d58cb0f req-9851a497-635d-44a9-813b-b3e21ef93b93 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] No waiting events found dispatching network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:22 user nova-compute[75813]: WARNING nova.compute.manager [req-413d7783-049e-44a5-ba20-6dd11d58cb0f req-9851a497-635d-44a9-813b-b3e21ef93b93 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received unexpected event network-vif-plugged-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c for instance with vm_state active and task_state deleting.
Nov 15 12:56:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-413d7783-049e-44a5-ba20-6dd11d58cb0f req-9851a497-635d-44a9-813b-b3e21ef93b93 service nova] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Received event network-vif-deleted-1d4549cc-1d5a-4548-86d8-1832e8ce3d4c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:23 user nova-compute[75813]: INFO nova.compute.manager [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] [instance: 36b32262-4ea0-4a33-9672-82c7b8061bb1] Took 0.87 seconds to detach 1 volumes for instance.
Nov 15 12:56:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:23 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:56:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:56:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:23 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Deleted allocations for instance 36b32262-4ea0-4a33-9672-82c7b8061bb1
Nov 15 12:56:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09c9ca86-4840-4d32-93ed-b7fce9c25d11 tempest-ServerActionsTestOtherB-1149556653 tempest-ServerActionsTestOtherB-1149556653-project-member] Lock "36b32262-4ea0-4a33-9672-82c7b8061bb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.499s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbpQSDvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:26 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:26 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:26 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cc3b74-ba34-4806-b6b2-680867b70ca6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:56:26 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d36da7-5c32-4048-b878-b463a29f9087]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47] added
Nov 15 12:56:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f456f1b-9c8f-4bde-a198-cb0f931818fd]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02313f9-853b-42f2-a98b-2e63d423a3bc]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbpQSDvT {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbpQSDvT" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8961c6c9-fa90-43c3-af66-9adf1a768057]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kbpQSDvT'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a1e3c2-cc69-46a2-ae7a-9b4f3046bf3f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7180c0cd-cd73-47d5-a6ff-f47a11916ed8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:26 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:26 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:26 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:26 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:26 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:26 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada3058e-7cb6-4511-b7fc-547004c7bdd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47, portal: 172.16.0.220,3260]
Nov 15 12:56:27 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47, portal: 172.16.0.220,3260] successful.
Nov 15 12:56:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1565c765-20c6-45a9-85fd-132888087d82]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cff19f1-3424-4963-91cf-90c2334e0f5c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:27 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:27 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:27 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:27 user nova-compute[75813]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:27 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:27 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:27 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:27 user nova-compute[75813]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[351b3454-55be-46bb-b271-7f85e831d8e1]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:56:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbpQSDvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:56:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26364666563326137', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364666563326137', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:56:28 user nova-compute[75813]: DEBUG nova.objects.instance [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:56:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:56:28 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:56:28 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 12:56:28 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:56:28 user nova-compute[75813]:   <serial>33601776-11c1-4870-9d0d-075125e6bf47</serial>
Nov 15 12:56:28 user nova-compute[75813]: </disk>
Nov 15 12:56:28 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:56:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:56:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:56:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No VIF found with MAC fa:16:3e:a5:07:30, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:56:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7baa5a80-1133-48fe-b649-567c2c24ff8b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.827s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-1a72f2ed-4878-43ca-964d-1856d93b2e71 req-58db08a8-6fb8-4e02-afa0-62e58fbf97b0 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-changed-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-1a72f2ed-4878-43ca-964d-1856d93b2e71 req-58db08a8-6fb8-4e02-afa0-62e58fbf97b0 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing instance network info cache due to event network-changed-343ad4aa-1f1e-4a58-88fa-d9ec606277e6. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:56:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1a72f2ed-4878-43ca-964d-1856d93b2e71 req-58db08a8-6fb8-4e02-afa0-62e58fbf97b0 service nova] Acquiring lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:56:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1a72f2ed-4878-43ca-964d-1856d93b2e71 req-58db08a8-6fb8-4e02-afa0-62e58fbf97b0 service nova] Acquired lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:56:29 user nova-compute[75813]: DEBUG nova.network.neutron [req-1a72f2ed-4878-43ca-964d-1856d93b2e71 req-58db08a8-6fb8-4e02-afa0-62e58fbf97b0 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Refreshing network info cache for port 343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:56:29 user nova-compute[75813]: DEBUG nova.network.neutron [req-1a72f2ed-4878-43ca-964d-1856d93b2e71 req-58db08a8-6fb8-4e02-afa0-62e58fbf97b0 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updated VIF entry in instance network info cache for port 343ad4aa-1f1e-4a58-88fa-d9ec606277e6. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:56:29 user nova-compute[75813]: DEBUG nova.network.neutron [req-1a72f2ed-4878-43ca-964d-1856d93b2e71 req-58db08a8-6fb8-4e02-afa0-62e58fbf97b0 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating instance_info_cache with network_info: [{"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:56:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1a72f2ed-4878-43ca-964d-1856d93b2e71 req-58db08a8-6fb8-4e02-afa0-62e58fbf97b0 service nova] Releasing lock "refresh_cache-794722de-e692-49f8-8bc9-ff64854ec405" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:56:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:31 user nova-compute[75813]: INFO nova.compute.manager [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Detaching volume 33601776-11c1-4870-9d0d-075125e6bf47
Nov 15 12:56:31 user nova-compute[75813]: INFO nova.virt.block_device [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attempting to driver detach volume 33601776-11c1-4870-9d0d-075125e6bf47 from mountpoint /dev/vdb
Nov 15 12:56:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Attempting to detach device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:56:31 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:56:31 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 12:56:31 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:56:31 user nova-compute[75813]:   <serial>33601776-11c1-4870-9d0d-075125e6bf47</serial>
Nov 15 12:56:31 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:56:31 user nova-compute[75813]: </disk>
Nov 15 12:56:31 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:56:31 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Successfully detached device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the persistent domain config.
Nov 15 12:56:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45154992-3213-43fa-89dc-d433f57ae978 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:56:31 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:56:31 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 12:56:31 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:56:31 user nova-compute[75813]:   <serial>33601776-11c1-4870-9d0d-075125e6bf47</serial>
Nov 15 12:56:31 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:56:31 user nova-compute[75813]: </disk>
Nov 15 12:56:31 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "794722de-e692-49f8-8bc9-ff64854ec405" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:31 user nova-compute[75813]: INFO nova.compute.manager [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Terminating instance
Nov 15 12:56:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-aea7e661-d923-46ab-b9fd-a62cade7aeb0 req-3528b439-0bb0-4933-92ac-563632b81c47 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-aea7e661-d923-46ab-b9fd-a62cade7aeb0 req-3528b439-0bb0-4933-92ac-563632b81c47 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-aea7e661-d923-46ab-b9fd-a62cade7aeb0 req-3528b439-0bb0-4933-92ac-563632b81c47 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-aea7e661-d923-46ab-b9fd-a62cade7aeb0 req-3528b439-0bb0-4933-92ac-563632b81c47 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-aea7e661-d923-46ab-b9fd-a62cade7aeb0 req-3528b439-0bb0-4933-92ac-563632b81c47 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-unplugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-aea7e661-d923-46ab-b9fd-a62cade7aeb0 req-3528b439-0bb0-4933-92ac-563632b81c47 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-b4ab1c4b-0476-4afa-aba4-2a27bb17c748 req-6c02a33e-9b15-4f72-b51f-e3a006ad3fb1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b4ab1c4b-0476-4afa-aba4-2a27bb17c748 req-6c02a33e-9b15-4f72-b51f-e3a006ad3fb1 service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b4ab1c4b-0476-4afa-aba4-2a27bb17c748 req-6c02a33e-9b15-4f72-b51f-e3a006ad3fb1 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b4ab1c4b-0476-4afa-aba4-2a27bb17c748 req-6c02a33e-9b15-4f72-b51f-e3a006ad3fb1 service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-b4ab1c4b-0476-4afa-aba4-2a27bb17c748 req-6c02a33e-9b15-4f72-b51f-e3a006ad3fb1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-unplugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-b4ab1c4b-0476-4afa-aba4-2a27bb17c748 req-6c02a33e-9b15-4f72-b51f-e3a006ad3fb1 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ecd70f1-a198-400f-8dcc-ad9166534cc5 req-2291f4a5-0f6f-4fc9-8064-f7f3e5da917e service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-c283df15-5363-4933-b3c1-95201604f7b2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ecd70f1-a198-400f-8dcc-ad9166534cc5 req-2291f4a5-0f6f-4fc9-8064-f7f3e5da917e service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ecd70f1-a198-400f-8dcc-ad9166534cc5 req-2291f4a5-0f6f-4fc9-8064-f7f3e5da917e service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ecd70f1-a198-400f-8dcc-ad9166534cc5 req-2291f4a5-0f6f-4fc9-8064-f7f3e5da917e service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ecd70f1-a198-400f-8dcc-ad9166534cc5 req-2291f4a5-0f6f-4fc9-8064-f7f3e5da917e service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-unplugged-c283df15-5363-4933-b3c1-95201604f7b2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ecd70f1-a198-400f-8dcc-ad9166534cc5 req-2291f4a5-0f6f-4fc9-8064-f7f3e5da917e service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-c283df15-5363-4933-b3c1-95201604f7b2 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Instance destroyed successfully.
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.objects.instance [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lazy-loading 'resources' on Instance uuid 794722de-e692-49f8-8bc9-ff64854ec405 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:fd:5c,bridge_name='br-int',has_traffic_filtering=True,id=343ad4aa-1f1e-4a58-88fa-d9ec606277e6,network=Network(22d0cdff-a461-41d6-9729-02e3ca3d8e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343ad4aa-1f') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:fd:5c,bridge_name='br-int',has_traffic_filtering=True,id=343ad4aa-1f1e-4a58-88fa-d9ec606277e6,network=Network(22d0cdff-a461-41d6-9729-02e3ca3d8e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343ad4aa-1f') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap343ad4aa-1f, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce253a44-a20d-4d83-8675-840a49d1dcdd) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: INFO os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:fd:5c,bridge_name='br-int',has_traffic_filtering=True,id=343ad4aa-1f1e-4a58-88fa-d9ec606277e6,network=Network(22d0cdff-a461-41d6-9729-02e3ca3d8e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343ad4aa-1f')
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:21:72,bridge_name='br-int',has_traffic_filtering=True,id=c283df15-5363-4933-b3c1-95201604f7b2,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc283df15-53') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:21:72,bridge_name='br-int',has_traffic_filtering=True,id=c283df15-5363-4933-b3c1-95201604f7b2,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc283df15-53') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc283df15-53, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c816ce70-fbb1-421e-9044-f865f2c246c4) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: INFO os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:21:72,bridge_name='br-int',has_traffic_filtering=True,id=c283df15-5363-4933-b3c1-95201604f7b2,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc283df15-53')
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:11:fe,bridge_name='br-int',has_traffic_filtering=True,id=c1044bb7-bc9d-4730-b0e4-fd2b50fece18,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1044bb7-bc') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:11:fe,bridge_name='br-int',has_traffic_filtering=True,id=c1044bb7-bc9d-4730-b0e4-fd2b50fece18,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1044bb7-bc') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1044bb7-bc, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=632b97e3-f6c8-4828-ad0e-8b39704b9ed5) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: INFO os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:11:fe,bridge_name='br-int',has_traffic_filtering=True,id=c1044bb7-bc9d-4730-b0e4-fd2b50fece18,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1044bb7-bc')
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e9:d6,bridge_name='br-int',has_traffic_filtering=True,id=2bdba87c-b645-4d17-9470-a5c9d8b7341e,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdba87c-b6') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e9:d6,bridge_name='br-int',has_traffic_filtering=True,id=2bdba87c-b645-4d17-9470-a5c9d8b7341e,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdba87c-b6') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bdba87c-b6, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=548875e4-a993-4321-b099-f54db71fe524) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: INFO os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e9:d6,bridge_name='br-int',has_traffic_filtering=True,id=2bdba87c-b645-4d17-9470-a5c9d8b7341e,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdba87c-b6')
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:95:62,bridge_name='br-int',has_traffic_filtering=True,id=b22b7864-5cdf-4a54-a11e-13cfa447176d,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b7864-5c') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:95:62,bridge_name='br-int',has_traffic_filtering=True,id=b22b7864-5cdf-4a54-a11e-13cfa447176d,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b7864-5c') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb22b7864-5c, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09250c74-2e3e-49ac-8fce-24e111c4b1fd) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: INFO os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:95:62,bridge_name='br-int',has_traffic_filtering=True,id=b22b7864-5cdf-4a54-a11e-13cfa447176d,network=Network(c373432b-7098-47f6-b118-62c55c83caf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22b7864-5c')
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:41:fe,bridge_name='br-int',has_traffic_filtering=True,id=c6ffea0d-cd4a-4764-90b8-6405da06ccf7,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6ffea0d-cd') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:41:fe,bridge_name='br-int',has_traffic_filtering=True,id=c6ffea0d-cd4a-4764-90b8-6405da06ccf7,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6ffea0d-cd') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6ffea0d-cd, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48b374bd-2680-41ec-97a6-6eef8336d28c) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: INFO os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:41:fe,bridge_name='br-int',has_traffic_filtering=True,id=c6ffea0d-cd4a-4764-90b8-6405da06ccf7,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6ffea0d-cd')
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T12:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249190170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249190170',id=18,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9tCnQL46t0mUIAs4U1CDu0obxeVT5Drp0easGv3Ugi0LWvBcBESldISYGZ/lyXRFFK4TGin4Vsjc+6H4m5Q3nB1OHElRuGPjIetuzb60v/MhvT0oh71NZkcX77RCouPw==',key_name='tempest-keypair-388288495',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='baca56dbe0004f82b45bd165781ff06f',ramdisk_id='',reservation_id='r-8upgtxzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-451109879',owner_user_name='tempest-TaggedBootDevicesTest_v242-451109879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e544761c815a47c2b414141e839dee47',uuid=794722de-e692-49f8-8bc9-ff64854ec405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converting VIF {"id": "d124ff05-0b46-42a8-a684-db795f1fca12", "address": "fa:16:3e:10:42:58", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd124ff05-0b", "ovs_interfaceid": "d124ff05-0b46-42a8-a684-db795f1fca12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:42:58,bridge_name='br-int',has_traffic_filtering=True,id=d124ff05-0b46-42a8-a684-db795f1fca12,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd124ff05-0b') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:42:58,bridge_name='br-int',has_traffic_filtering=True,id=d124ff05-0b46-42a8-a684-db795f1fca12,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd124ff05-0b') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd124ff05-0b, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bfd52d7-a213-4b1a-b37e-adec3ee7bdfb) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:33 user nova-compute[75813]: INFO os_vif [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:42:58,bridge_name='br-int',has_traffic_filtering=True,id=d124ff05-0b46-42a8-a684-db795f1fca12,network=Network(9b031b34-7d65-4e2b-b1d4-e0119936864b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd124ff05-0b')
Nov 15 12:56:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEoBgLUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:34 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[48daefcb-7ffb-4de9-8174-f0f50042c76e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:56:34 user nova-compute[75813]: No targets found.
Nov 15 12:56:34 user nova-compute[75813]: iSNS:
Nov 15 12:56:34 user nova-compute[75813]: No targets found.
Nov 15 12:56:34 user nova-compute[75813]: STATIC:
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: FIRMWARE:
Nov 15 12:56:34 user nova-compute[75813]: No targets found.
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:56:34 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:56:34 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[860dcb2a-24a7-4017-a13c-6a4e87488fb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04e01e2-a6f3-4a3b-a88b-2d373069aa3f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550255fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09'): ({'sdd'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Removing single pathed devices sdd {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a43b87b-70d9-4818-9b73-7974afcde12d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d244c623-05c0-4453-a437-c422dacaf2b8]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Flushing IO for device /dev/sdd {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:34 user nova-compute[75813]: WARNING nova.compute.manager [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 for instance with vm_state active and task_state deleting.
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-unplugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:34 user nova-compute[75813]: WARNING nova.compute.manager [req-ceb21225-d103-47e3-ad3c-09df8c167f9f req-3836c146-a0ae-43d7-8992-6338604db6da service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 for instance with vm_state active and task_state deleting.
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb98de12-c35c-44f3-ba9c-fb6edc823420]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9c1df9-6e3d-4dfa-9d82-5b4ab08935ab]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[357829ad-b75a-4fa1-bc79-e799fe583642]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[316ac734-996b-4d3e-a340-633b50552cfd]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09, portal: 172.16.0.220,3260]
Nov 15 12:56:34 user nova-compute[75813]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09, portal: 172.16.0.220,3260] successful.
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:848ab383-3042-43de-9652-8073233fae09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c95e180-72bc-441b-8b7c-d89a02122162]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] <== disconnect_volume: return (324ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWwrpnQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:34 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a94fc91-7f3d-444b-a65c-add8738c4b1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:56:34 user nova-compute[75813]: No targets found.
Nov 15 12:56:34 user nova-compute[75813]: iSNS:
Nov 15 12:56:34 user nova-compute[75813]: No targets found.
Nov 15 12:56:34 user nova-compute[75813]: STATIC:
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: FIRMWARE:
Nov 15 12:56:34 user nova-compute[75813]: No targets found.
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:56:34 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:56:34 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:34 user nova-compute[75813]: WARNING nova.compute.manager [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-c1044bb7-bc9d-4730-b0e4-fd2b50fece18 for instance with vm_state active and task_state deleting.
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-unplugged-b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-b22b7864-5cdf-4a54-a11e-13cfa447176d for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:34 user nova-compute[75813]: WARNING nova.compute.manager [req-77354217-42c2-4c10-afa0-94b3a57bfe4b req-d8ddc3a4-f14f-4af7-b135-6f9b94ca78af service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-b22b7864-5cdf-4a54-a11e-13cfa447176d for instance with vm_state active and task_state deleting.
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e51c94f-501d-4871-8956-9bf2a2233195]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca492af-05d4-4fe9-af1c-42df49cef2e1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55307664d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606'): ({'sde'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Removing single pathed devices sde {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ce250e-6bd3-4e90-a46f-b23af0ae4bf6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18e0d5-2596-4aee-aa86-8bbd83b0ccef]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Flushing IO for device /dev/sde {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-c283df15-5363-4933-b3c1-95201604f7b2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-c283df15-5363-4933-b3c1-95201604f7b2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:34 user nova-compute[75813]: WARNING nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-c283df15-5363-4933-b3c1-95201604f7b2 for instance with vm_state active and task_state deleting.
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-unplugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:34 user nova-compute[75813]: WARNING nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-2bdba87c-b645-4d17-9470-a5c9d8b7341e for instance with vm_state active and task_state deleting.
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-unplugged-d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-unplugged-d124ff05-0b46-42a8-a684-db795f1fca12 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-plugged-d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Acquiring lock "794722de-e692-49f8-8bc9-ff64854ec405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] Lock "794722de-e692-49f8-8bc9-ff64854ec405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] No waiting events found dispatching network-vif-plugged-d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:56:34 user nova-compute[75813]: WARNING nova.compute.manager [req-374b04dc-5a04-4b29-a68b-f872645e04c9 req-4f6800e9-341e-4870-8045-466c1287be7b service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received unexpected event network-vif-plugged-d124ff05-0b46-42a8-a684-db795f1fca12 for instance with vm_state active and task_state deleting.
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22e8fc2-32b0-48aa-9b2e-45cd739eaea3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba8a7c8-af08-46aa-b985-1ab185b4140a]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adeca08-ef59-4284-950d-bbf8fe5ce7ae]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d495ac84-3d33-43f9-8762-5c0989a710f3]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606, portal: 172.16.0.220,3260]
Nov 15 12:56:34 user nova-compute[75813]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606, portal: 172.16.0.220,3260] successful.
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75697ebd-3d5d-4bd1-aeaa-b8f07ed19606 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f8403-254e-4546-a9b2-9501ea6db376]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] <== disconnect_volume: return (318ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NnbDqjBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:34 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fc2801-4094-4498-b0a8-63606ae66afc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:56:34 user nova-compute[75813]: No targets found.
Nov 15 12:56:34 user nova-compute[75813]: iSNS:
Nov 15 12:56:34 user nova-compute[75813]: No targets found.
Nov 15 12:56:34 user nova-compute[75813]: STATIC:
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b
Nov 15 12:56:34 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:34 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:34 user nova-compute[75813]: FIRMWARE:
Nov 15 12:56:34 user nova-compute[75813]: No targets found.
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:56:34 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:56:34 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[387f9e86-0a1e-415a-8543-643faedd62ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07bcc40-22a9-4bfc-a8f9-817d84e9aa75]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:34 user nova-compute[75813]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5530640d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837'): ({'sdg'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Removing single pathed devices sdg {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cbe3a7-b558-4ce3-9349-86730dfaa8ab]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91676d7-d288-47d0-bc86-6e78a626682d]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Flushing IO for device /dev/sdg {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.011s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3ea909-319e-46ac-a486-8e60f5572f05]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac7d13b-edd1-46a3-9421-81cf1a2b9acb]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] SCSI volumes sdg have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f3f745-1995-4f9c-9ba4-aeec6431c182]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0865df6f-6dfe-4fb4-bf75-c58a683e6590]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837, portal: 172.16.0.220,3260]
Nov 15 12:56:34 user nova-compute[75813]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837, portal: 172.16.0.220,3260] successful.
Nov 15 12:56:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31960f1c-e93b-4e10-9fdc-97b28904c837 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abcfe2e-5960-4d1e-bfbf-1f3fe593c757]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] <== disconnect_volume: return (270ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:56:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Deleting instance files /opt/stack/data/nova/instances/794722de-e692-49f8-8bc9-ff64854ec405_del
Nov 15 12:56:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Deletion of /opt/stack/data/nova/instances/794722de-e692-49f8-8bc9-ff64854ec405_del complete
Nov 15 12:56:34 user nova-compute[75813]: INFO nova.compute.manager [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Took 3.18 seconds to destroy the instance on the hypervisor.
Nov 15 12:56:34 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:56:35 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4bf92268-8acd-4092-94ed-3ae2b85b4f8e is timed out.
Nov 15 12:56:35 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully detached device vdb from instance 4bf92268-8acd-4092-94ed-3ae2b85b4f8e from the live domain config.
Nov 15 12:56:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOIhuTvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:35 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c8f830-0db9-43b9-9a7d-89e662986b8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:56:35 user nova-compute[75813]: No targets found.
Nov 15 12:56:35 user nova-compute[75813]: iSNS:
Nov 15 12:56:35 user nova-compute[75813]: No targets found.
Nov 15 12:56:35 user nova-compute[75813]: STATIC:
Nov 15 12:56:35 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47
Nov 15 12:56:35 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:35 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:35 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b
Nov 15 12:56:35 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:35 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:35 user nova-compute[75813]: FIRMWARE:
Nov 15 12:56:35 user nova-compute[75813]: No targets found.
Nov 15 12:56:35 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:56:35 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:56:35 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f66c22b-6f25-48b5-a997-562cffd497fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f1a282-4e40-4ede-af67-30dac2ee75a9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:35 user nova-compute[75813]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:35 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b (non-flash)
Nov 15 12:56:35 user nova-compute[75813]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:35 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550256c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b'): ({'sdc'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Removing single pathed devices sdc {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12a46b3-8783-4a76-b503-7f7842379e48]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[28507f72-53ae-4296-a684-d484770dd17b]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Flushing IO for device /dev/sdc {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6998f479-35b2-499b-8787-2fb1ee40afbf]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccc68f3-0dba-4307-b5db-ceb36294cbd3]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eb09ea-48b3-4c70-b737-dcad18b7227d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b7b58a-3ecb-4ffa-8221-68790821f15d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b, portal: 172.16.0.220,3260]
Nov 15 12:56:35 user nova-compute[75813]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b, portal: 172.16.0.220,3260] successful.
Nov 15 12:56:35 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8a6ad-fc40-4652-8763-67638a68745b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c168db9-dbdc-45cd-aa76-892d9f35daad]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] <== disconnect_volume: return (320ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:56:36 user nova-compute[75813]: DEBUG nova.objects.instance [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'flavor' on Instance uuid 4bf92268-8acd-4092-94ed-3ae2b85b4f8e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:56:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-463f7482-8f1b-44b7-afd5-cf90cdab2e07 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.666s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-bd6ab5f8-3c6d-4e75-b591-b5c1c83f7675 req-b48c2b04-f8ad-4091-be68-9540345ba6e3 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-deleted-d124ff05-0b46-42a8-a684-db795f1fca12 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:37 user nova-compute[75813]: INFO nova.compute.manager [req-bd6ab5f8-3c6d-4e75-b591-b5c1c83f7675 req-b48c2b04-f8ad-4091-be68-9540345ba6e3 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Neutron deleted interface d124ff05-0b46-42a8-a684-db795f1fca12; detaching it from the instance and deleting it from the info cache
Nov 15 12:56:37 user nova-compute[75813]: DEBUG nova.network.neutron [req-bd6ab5f8-3c6d-4e75-b591-b5c1c83f7675 req-b48c2b04-f8ad-4091-be68-9540345ba6e3 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating instance_info_cache with network_info: [{"id": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "address": "fa:16:3e:18:fd:5c", "network": {"id": "22d0cdff-a461-41d6-9729-02e3ca3d8e67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1573289085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343ad4aa-1f", "ovs_interfaceid": "343ad4aa-1f1e-4a58-88fa-d9ec606277e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c283df15-5363-4933-b3c1-95201604f7b2", "address": "fa:16:3e:5b:21:72", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc283df15-53", "ovs_interfaceid": "c283df15-5363-4933-b3c1-95201604f7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "address": "fa:16:3e:67:11:fe", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1044bb7-bc", "ovs_interfaceid": "c1044bb7-bc9d-4730-b0e4-fd2b50fece18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "address": "fa:16:3e:3c:e9:d6", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdba87c-b6", "ovs_interfaceid": "2bdba87c-b645-4d17-9470-a5c9d8b7341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "address": "fa:16:3e:ed:95:62", "network": {"id": "c373432b-7098-47f6-b118-62c55c83caf7", "bridge": "br-int", "label": "tempest-device-tagging-net1-959552605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22b7864-5c", "ovs_interfaceid": "b22b7864-5cdf-4a54-a11e-13cfa447176d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "address": "fa:16:3e:12:41:fe", "network": {"id": "9b031b34-7d65-4e2b-b1d4-e0119936864b", "bridge": "br-int", "label": "tempest-device-tagging-net2-230627121", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "baca56dbe0004f82b45bd165781ff06f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ffea0d-cd", "ovs_interfaceid": "c6ffea0d-cd4a-4764-90b8-6405da06ccf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:56:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-bd6ab5f8-3c6d-4e75-b591-b5c1c83f7675 req-b48c2b04-f8ad-4091-be68-9540345ba6e3 service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Detach interface failed, port_id=d124ff05-0b46-42a8-a684-db795f1fca12, reason: Instance 794722de-e692-49f8-8bc9-ff64854ec405 could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 12:56:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:38 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:56:38 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Took 3.57 seconds to deallocate network for instance.
Nov 15 12:56:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-41252556-af4e-4d83-b47a-f1a33daa8a28 req-6da01700-f830-4ac3-8d1e-74a4c4827c0f service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-deleted-b22b7864-5cdf-4a54-a11e-13cfa447176d {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-41252556-af4e-4d83-b47a-f1a33daa8a28 req-6da01700-f830-4ac3-8d1e-74a4c4827c0f service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-deleted-343ad4aa-1f1e-4a58-88fa-d9ec606277e6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-41252556-af4e-4d83-b47a-f1a33daa8a28 req-6da01700-f830-4ac3-8d1e-74a4c4827c0f service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-deleted-2bdba87c-b645-4d17-9470-a5c9d8b7341e {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-41252556-af4e-4d83-b47a-f1a33daa8a28 req-6da01700-f830-4ac3-8d1e-74a4c4827c0f service nova] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Received event network-vif-deleted-c6ffea0d-cd4a-4764-90b8-6405da06ccf7 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:41 user nova-compute[75813]: INFO nova.compute.manager [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] [instance: 794722de-e692-49f8-8bc9-ff64854ec405] Took 2.55 seconds to detach 3 volumes for instance.
Nov 15 12:56:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:41 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:56:41 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:56:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:41 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Deleted allocations for instance 794722de-e692-49f8-8bc9-ff64854ec405
Nov 15 12:56:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cfe91f46-888b-49d9-bded-696391e470be tempest-TaggedBootDevicesTest_v242-451109879 tempest-TaggedBootDevicesTest_v242-451109879-project-member] Lock "794722de-e692-49f8-8bc9-ff64854ec405" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.697s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:56:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:56:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:56:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:56:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:56:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:56:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Updating instance_info_cache with network_info: [{"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:56:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:56:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:56:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:56:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:56:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:56:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:56:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:56:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:56:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:49 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:56:49 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:56:49 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8453MB free_disk=25.428428649902344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 45154992-3213-43fa-89dc-d433f57ae978 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4bf92268-8acd-4092-94ed-3ae2b85b4f8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 9693ad51-4044-46be-a5dc-00db9bf198bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:56:50 user nova-compute[75813]: INFO nova.compute.claims [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Claim successful on node user
Nov 15 12:56:50 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:56:50 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:56:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG nova.policy [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '364157f6888d42c88318ab5f31b8132d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f529adeb6b4124af5c49898ea718e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:56:50 user nova-compute[75813]: INFO nova.virt.block_device [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Booting with volume 106603c8-fd70-43d5-bf39-d27c20b9259d at /dev/vda
Nov 15 12:56:50 user nova-compute[75813]: DEBUG os_brick.utils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b56b74-3d6e-4e4a-997e-43f666268c7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e77dcb-825c-4460-a95b-1672a7b8a45e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c301e5-095b-4603-a68c-137ce38fd08a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[86398bc8-5e91-4d3e-9e60-74ddb270b1e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:56:50 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:56:50 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2b7de6-7f88-4bca-8cab-39775327c5f2]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG os_brick.utils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:50 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating existing volume attachment record: a95fd4f5-8339-40c6-9244-add4eff2e883 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Successfully created port: 3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:56:51 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45154992-3213-43fa-89dc-d433f57ae978 is timed out.
Nov 15 12:56:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Successfully detached device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the live domain config.
Nov 15 12:56:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbpQSDvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:51 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c5e745-743f-404a-9b70-dfee8ca735ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:56:51 user nova-compute[75813]: No targets found.
Nov 15 12:56:51 user nova-compute[75813]: iSNS:
Nov 15 12:56:51 user nova-compute[75813]: No targets found.
Nov 15 12:56:51 user nova-compute[75813]: STATIC:
Nov 15 12:56:51 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47
Nov 15 12:56:51 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:56:51 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:56:51 user nova-compute[75813]: FIRMWARE:
Nov 15 12:56:51 user nova-compute[75813]: No targets found.
Nov 15 12:56:51 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:56:51 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:56:51 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14bd539-f5e1-4ceb-b5ea-0c1952d86151]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7371af-14df-4b32-9f76-d508413cbf9a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:51 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 (non-flash)
Nov 15 12:56:51 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555186f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9491ec6d-f8d6-455b-b1db-8ffb2b94147b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f32fe1b-3fd0-468e-8020-aea9bdb7e04c]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be25c94-da46-4489-a54c-b67eb2986fa8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c532484-6401-453d-b70f-13e6e51df76a]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de63aca-5d87-4998-a1b8-a2055eb2fc2b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Successfully updated port: 3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[111c2360-bf66-4ad7-8432-a68f7368a01e]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47, portal: 172.16.0.220,3260]
Nov 15 12:56:51 user nova-compute[75813]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47, portal: 172.16.0.220,3260] successful.
Nov 15 12:56:51 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquired lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33601776-11c1-4870-9d0d-075125e6bf47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a68ea-b279-4cc5-8a15-eb4f12fbd752]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== disconnect_volume: return (299ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-7ebb3829-c424-4b01-8230-971ac38556f2 req-b99c424a-3a6e-4508-8c80-412fdcda03e2 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-changed-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-7ebb3829-c424-4b01-8230-971ac38556f2 req-b99c424a-3a6e-4508-8c80-412fdcda03e2 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Refreshing instance network info cache due to event network-changed-3319e5d9-873b-44f6-bdd3-613b8a0a111f. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7ebb3829-c424-4b01-8230-971ac38556f2 req-b99c424a-3a6e-4508-8c80-412fdcda03e2 service nova] Acquiring lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating instance_info_cache with network_info: [{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Releasing lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Instance network_info: |[{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7ebb3829-c424-4b01-8230-971ac38556f2 req-b99c424a-3a6e-4508-8c80-412fdcda03e2 service nova] Acquired lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG nova.network.neutron [req-7ebb3829-c424-4b01-8230-971ac38556f2 req-b99c424a-3a6e-4508-8c80-412fdcda03e2 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Refreshing network info cache for port 3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG nova.network.neutron [req-7ebb3829-c424-4b01-8230-971ac38556f2 req-b99c424a-3a6e-4508-8c80-412fdcda03e2 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updated VIF entry in instance network info cache for port 3319e5d9-873b-44f6-bdd3-613b8a0a111f. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG nova.network.neutron [req-7ebb3829-c424-4b01-8230-971ac38556f2 req-b99c424a-3a6e-4508-8c80-412fdcda03e2 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating instance_info_cache with network_info: [{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG nova.objects.instance [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7ebb3829-c424-4b01-8230-971ac38556f2 req-b99c424a-3a6e-4508-8c80-412fdcda03e2 service nova] Releasing lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:56:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f4d355c4-bc4a-478b-8f02-af809d76cb7b tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.642s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:56:55 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Creating image(s)
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Ensure instance console log exists: /opt/stack/data/nova/instances/be6a3a9f-c85c-4de8-b035-a4bead582c96/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Start _get_guest_xml network_info=[{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'a95fd4f5-8339-40c6-9244-add4eff2e883', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZVKXryl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be6a3a9f-c85c-4de8-b035-a4bead582c96', 'attached_at': '', 'detached_at': '', 'volume_id': '106603c8-fd70-43d5-bf39-d27c20b9259d', 'serial': '106603c8-fd70-43d5-bf39-d27c20b9259d'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:56:55 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:56:55 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZVKXryl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:56:55 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:55 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:56:55 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13c7251-c03e-4432-80fe-9c13fae351bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:56:55 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0effb706-046e-4d07-b181-32de05a8efe0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d] added
Nov 15 12:56:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86c8905-17b4-43f0-b73b-e049081e4315]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90d9e59-56c3-4a46-9375-db28d7059527]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZVKXryl {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZVKXryl" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52224c8-2f8b-4623-b9e4-f7819c9e10a3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zZVKXryl'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed14c6e6-0093-4be5-97dc-d487e1f83c87]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[08617ceb-14f1-4ec2-9d9f-81c9220f7377]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:56:55 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:56:55 user nova-compute[75813]:  {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:55 user nova-compute[75813]: WARNING os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 12:56:55 user nova-compute[75813]: 
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9a2276-57b6-4ab4-ae4f-87d60c826c18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260]
Nov 15 12:56:55 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260] successful.
Nov 15 12:56:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d0a23c-fb4e-45d0-888e-10601ddaa97e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb9cc62-c346-44e8-88be-cbb6eb402800]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 12:56:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 12:56:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4355273a-5f6e-4b95-ae24-b4875c337c53]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:56:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZVKXryl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23961633061303231', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961633061303231', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1098721025',display_name='tempest-TestShelveInstance-server-1098721025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1098721025',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7N7MsxwT9JHHOFY9/PU8NI9pb7YXiy99jSoN272W+h+mOZ1+NJCSLRF4zDMoW1GoNvbRiXMBTud9XsJi3Zb6Vv5F32/zy56U70aKYebYlSDUaUmernScIGry8ivWyy6g==',key_name='tempest-TestShelveInstance-175836121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f529adeb6b4124af5c49898ea718e1',ramdisk_id='',reservation_id='r-5dos5dei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-758391741',owner_user_name='tempest-TestShelveInstance-758391741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:56:51Z,user_data=None,user_id='364157f6888d42c88318ab5f31b8132d',uuid=be6a3a9f-c85c-4de8-b035-a4bead582c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converting VIF {"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG nova.objects.instance [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lazy-loading 'pci_devices' on Instance uuid be6a3a9f-c85c-4de8-b035-a4bead582c96 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:56:56 user nova-compute[75813]:   <uuid>be6a3a9f-c85c-4de8-b035-a4bead582c96</uuid>
Nov 15 12:56:56 user nova-compute[75813]:   <name>instance-00000014</name>
Nov 15 12:56:56 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:56:56 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:56:56 user nova-compute[75813]:   <metadata>
Nov 15 12:56:56 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:56:56 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:56:56 user nova-compute[75813]:       <nova:name>tempest-TestShelveInstance-server-1098721025</nova:name>
Nov 15 12:56:56 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:56:55</nova:creationTime>
Nov 15 12:56:56 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:56:56 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:56:56 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:56:56 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:56:56 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:56:56 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:56:56 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:56:56 user nova-compute[75813]:       <nova:owner>
Nov 15 12:56:56 user nova-compute[75813]:         <nova:user uuid="364157f6888d42c88318ab5f31b8132d">tempest-TestShelveInstance-758391741-project-member</nova:user>
Nov 15 12:56:56 user nova-compute[75813]:         <nova:project uuid="05f529adeb6b4124af5c49898ea718e1">tempest-TestShelveInstance-758391741</nova:project>
Nov 15 12:56:56 user nova-compute[75813]:       </nova:owner>
Nov 15 12:56:56 user nova-compute[75813]:       <nova:ports>
Nov 15 12:56:56 user nova-compute[75813]:         <nova:port uuid="3319e5d9-873b-44f6-bdd3-613b8a0a111f">
Nov 15 12:56:56 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 12:56:56 user nova-compute[75813]:         </nova:port>
Nov 15 12:56:56 user nova-compute[75813]:       </nova:ports>
Nov 15 12:56:56 user nova-compute[75813]:     </nova:instance>
Nov 15 12:56:56 user nova-compute[75813]:   </metadata>
Nov 15 12:56:56 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:56:56 user nova-compute[75813]:     <system>
Nov 15 12:56:56 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:56:56 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:56:56 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:56:56 user nova-compute[75813]:       <entry name="serial">be6a3a9f-c85c-4de8-b035-a4bead582c96</entry>
Nov 15 12:56:56 user nova-compute[75813]:       <entry name="uuid">be6a3a9f-c85c-4de8-b035-a4bead582c96</entry>
Nov 15 12:56:56 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:56:56 user nova-compute[75813]:     </system>
Nov 15 12:56:56 user nova-compute[75813]:   </sysinfo>
Nov 15 12:56:56 user nova-compute[75813]:   <os>
Nov 15 12:56:56 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:56:56 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:56:56 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:56:56 user nova-compute[75813]:   </os>
Nov 15 12:56:56 user nova-compute[75813]:   <features>
Nov 15 12:56:56 user nova-compute[75813]:     <acpi/>
Nov 15 12:56:56 user nova-compute[75813]:     <apic/>
Nov 15 12:56:56 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:56:56 user nova-compute[75813]:   </features>
Nov 15 12:56:56 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:56:56 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:56:56 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:56:56 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:56:56 user nova-compute[75813]:   </clock>
Nov 15 12:56:56 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:56:56 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:56:56 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:56:56 user nova-compute[75813]:   </cpu>
Nov 15 12:56:56 user nova-compute[75813]:   <devices>
Nov 15 12:56:56 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 12:56:56 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:56:56 user nova-compute[75813]:       <source dev="/dev/sdb"/>
Nov 15 12:56:56 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:56:56 user nova-compute[75813]:       <serial>106603c8-fd70-43d5-bf39-d27c20b9259d</serial>
Nov 15 12:56:56 user nova-compute[75813]:     </disk>
Nov 15 12:56:56 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:56:56 user nova-compute[75813]:       <mac address="fa:16:3e:fe:00:f3"/>
Nov 15 12:56:56 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:56:56 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:56:56 user nova-compute[75813]:       <target dev="tap3319e5d9-87"/>
Nov 15 12:56:56 user nova-compute[75813]:     </interface>
Nov 15 12:56:56 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:56:56 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/be6a3a9f-c85c-4de8-b035-a4bead582c96/console.log" append="off"/>
Nov 15 12:56:56 user nova-compute[75813]:     </serial>
Nov 15 12:56:56 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:56:56 user nova-compute[75813]:     <video>
Nov 15 12:56:56 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:56:56 user nova-compute[75813]:     </video>
Nov 15 12:56:56 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:56:56 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:56:56 user nova-compute[75813]:     </rng>
Nov 15 12:56:56 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:56:56 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:56:56 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:56:56 user nova-compute[75813]:     </memballoon>
Nov 15 12:56:56 user nova-compute[75813]:   </devices>
Nov 15 12:56:56 user nova-compute[75813]: </domain>
Nov 15 12:56:56 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1098721025',display_name='tempest-TestShelveInstance-server-1098721025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1098721025',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7N7MsxwT9JHHOFY9/PU8NI9pb7YXiy99jSoN272W+h+mOZ1+NJCSLRF4zDMoW1GoNvbRiXMBTud9XsJi3Zb6Vv5F32/zy56U70aKYebYlSDUaUmernScIGry8ivWyy6g==',key_name='tempest-TestShelveInstance-175836121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f529adeb6b4124af5c49898ea718e1',ramdisk_id='',reservation_id='r-5dos5dei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-758391741',owner_user_name='tempest-TestShelveInstance-758391741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:56:51Z,user_data=None,user_id='364157f6888d42c88318ab5f31b8132d',uuid=be6a3a9f-c85c-4de8-b035-a4bead582c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converting VIF {"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG os_vif [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1799c01-7eec-5d0c-8bd5-1ef3e22ba188', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3319e5d9-87, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3319e5d9-87, col_values=(('qos', UUID('e1b91ee7-4fc6-4d5e-8a86-df984dbb683a')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3319e5d9-87, col_values=(('external_ids', {'iface-id': '3319e5d9-873b-44f6-bdd3-613b8a0a111f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:00:f3', 'vm-uuid': 'be6a3a9f-c85c-4de8-b035-a4bead582c96'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:56:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:57 user nova-compute[75813]: INFO os_vif [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87')
Nov 15 12:56:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:56:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] No VIF found with MAC fa:16:3e:fe:00:f3, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:56:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:56:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:00 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:57:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:57:00 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Instance spawned successfully.
Nov 15 12:57:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:57:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:00 user nova-compute[75813]: INFO nova.compute.manager [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 15 12:57:00 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:57:00 user nova-compute[75813]: INFO nova.compute.manager [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Took 10.57 seconds to build instance.
Nov 15 12:57:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9abf5749-bddf-4421-acfc-47ac933ac2ae tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.702s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:57:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:57:01 user nova-compute[75813]: INFO nova.compute.claims [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Claim successful on node user
Nov 15 12:57:01 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:57:01 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:57:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:57:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:57:02 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:57:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG nova.policy [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f68d31c0d9bc4a66b3d81a892dee65ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78719b197c4db7bc6a13e3a57f3cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:57:02 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Creating image(s)
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "/opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "/opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "/opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk 1073741824" returned: 0 in 0.046s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Successfully created port: 8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Cannot resize image /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Ensure instance console log exists: /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Successfully updated port: 8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquired lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-83878d36-02a7-4fe7-b4af-24db17091350 req-0fa57aa3-652f-442c-a127-e6e82dcfdbb0 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-changed-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-83878d36-02a7-4fe7-b4af-24db17091350 req-0fa57aa3-652f-442c-a127-e6e82dcfdbb0 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Refreshing instance network info cache due to event network-changed-8472db86-c1ef-4c6a-a878-5951fa94e2e1. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83878d36-02a7-4fe7-b4af-24db17091350 req-0fa57aa3-652f-442c-a127-e6e82dcfdbb0 service nova] Acquiring lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updating instance_info_cache with network_info: [{"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Releasing lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance network_info: |[{"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83878d36-02a7-4fe7-b4af-24db17091350 req-0fa57aa3-652f-442c-a127-e6e82dcfdbb0 service nova] Acquired lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-83878d36-02a7-4fe7-b4af-24db17091350 req-0fa57aa3-652f-442c-a127-e6e82dcfdbb0 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Refreshing network info cache for port 8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Start _get_guest_xml network_info=[{"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:57:03 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:57:03 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1560614732',display_name='tempest-AttachVolumeTestJSON-server-1560614732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1560614732',id=21,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnbNba04CbeL7eAssBt/FmQ/iYfKbd5Suudux+Uq/+hDAu0UbaSznFUIXj3nEyetGtTpXd7+WYrSD1d+9oe6ooGQlSFefp1/qlmhmSqQ0sJ7qT77xL5D4H51OLc73q6+w==',key_name='tempest-keypair-1745276063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-8n5drqmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=525b3797-8d57-4bff-8ad9-4d53a8beaea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.objects.instance [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'pci_devices' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:57:03 user nova-compute[75813]:   <uuid>525b3797-8d57-4bff-8ad9-4d53a8beaea4</uuid>
Nov 15 12:57:03 user nova-compute[75813]:   <name>instance-00000015</name>
Nov 15 12:57:03 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:57:03 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:57:03 user nova-compute[75813]:   <metadata>
Nov 15 12:57:03 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:57:03 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:57:03 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeTestJSON-server-1560614732</nova:name>
Nov 15 12:57:03 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:57:03</nova:creationTime>
Nov 15 12:57:03 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:57:03 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:57:03 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:57:03 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:57:03 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:57:03 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:57:03 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:57:03 user nova-compute[75813]:       <nova:owner>
Nov 15 12:57:03 user nova-compute[75813]:         <nova:user uuid="f68d31c0d9bc4a66b3d81a892dee65ef">tempest-AttachVolumeTestJSON-45300677-project-member</nova:user>
Nov 15 12:57:03 user nova-compute[75813]:         <nova:project uuid="fc78719b197c4db7bc6a13e3a57f3cb2">tempest-AttachVolumeTestJSON-45300677</nova:project>
Nov 15 12:57:03 user nova-compute[75813]:       </nova:owner>
Nov 15 12:57:03 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:57:03 user nova-compute[75813]:       <nova:ports>
Nov 15 12:57:03 user nova-compute[75813]:         <nova:port uuid="8472db86-c1ef-4c6a-a878-5951fa94e2e1">
Nov 15 12:57:03 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 12:57:03 user nova-compute[75813]:         </nova:port>
Nov 15 12:57:03 user nova-compute[75813]:       </nova:ports>
Nov 15 12:57:03 user nova-compute[75813]:     </nova:instance>
Nov 15 12:57:03 user nova-compute[75813]:   </metadata>
Nov 15 12:57:03 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:57:03 user nova-compute[75813]:     <system>
Nov 15 12:57:03 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:57:03 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:57:03 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:57:03 user nova-compute[75813]:       <entry name="serial">525b3797-8d57-4bff-8ad9-4d53a8beaea4</entry>
Nov 15 12:57:03 user nova-compute[75813]:       <entry name="uuid">525b3797-8d57-4bff-8ad9-4d53a8beaea4</entry>
Nov 15 12:57:03 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:57:03 user nova-compute[75813]:     </system>
Nov 15 12:57:03 user nova-compute[75813]:   </sysinfo>
Nov 15 12:57:03 user nova-compute[75813]:   <os>
Nov 15 12:57:03 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:57:03 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:57:03 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:57:03 user nova-compute[75813]:   </os>
Nov 15 12:57:03 user nova-compute[75813]:   <features>
Nov 15 12:57:03 user nova-compute[75813]:     <acpi/>
Nov 15 12:57:03 user nova-compute[75813]:     <apic/>
Nov 15 12:57:03 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:57:03 user nova-compute[75813]:   </features>
Nov 15 12:57:03 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:57:03 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:57:03 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:57:03 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:57:03 user nova-compute[75813]:   </clock>
Nov 15 12:57:03 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:57:03 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:57:03 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:57:03 user nova-compute[75813]:   </cpu>
Nov 15 12:57:03 user nova-compute[75813]:   <devices>
Nov 15 12:57:03 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:57:03 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:57:03 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk"/>
Nov 15 12:57:03 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:57:03 user nova-compute[75813]:     </disk>
Nov 15 12:57:03 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:57:03 user nova-compute[75813]:       <mac address="fa:16:3e:2f:03:54"/>
Nov 15 12:57:03 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:57:03 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:57:03 user nova-compute[75813]:       <target dev="tap8472db86-c1"/>
Nov 15 12:57:03 user nova-compute[75813]:     </interface>
Nov 15 12:57:03 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:57:03 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/console.log" append="off"/>
Nov 15 12:57:03 user nova-compute[75813]:     </serial>
Nov 15 12:57:03 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:57:03 user nova-compute[75813]:     <video>
Nov 15 12:57:03 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:57:03 user nova-compute[75813]:     </video>
Nov 15 12:57:03 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:57:03 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:57:03 user nova-compute[75813]:     </rng>
Nov 15 12:57:03 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:57:03 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:57:03 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:57:03 user nova-compute[75813]:     </memballoon>
Nov 15 12:57:03 user nova-compute[75813]:   </devices>
Nov 15 12:57:03 user nova-compute[75813]: </domain>
Nov 15 12:57:03 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1560614732',display_name='tempest-AttachVolumeTestJSON-server-1560614732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1560614732',id=21,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnbNba04CbeL7eAssBt/FmQ/iYfKbd5Suudux+Uq/+hDAu0UbaSznFUIXj3nEyetGtTpXd7+WYrSD1d+9oe6ooGQlSFefp1/qlmhmSqQ0sJ7qT77xL5D4H51OLc73q6+w==',key_name='tempest-keypair-1745276063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-8n5drqmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=525b3797-8d57-4bff-8ad9-4d53a8beaea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG os_vif [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3878150a-a48e-5455-9d92-d6557040766e', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8472db86-c1, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8472db86-c1, col_values=(('qos', UUID('0f0b7327-d8cb-49e3-9284-4864a896ead0')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8472db86-c1, col_values=(('external_ids', {'iface-id': '8472db86-c1ef-4c6a-a878-5951fa94e2e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:03:54', 'vm-uuid': '525b3797-8d57-4bff-8ad9-4d53a8beaea4'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:03 user nova-compute[75813]: INFO os_vif [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1')
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:57:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No VIF found with MAC fa:16:3e:2f:03:54, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:57:04 user nova-compute[75813]: DEBUG nova.network.neutron [req-83878d36-02a7-4fe7-b4af-24db17091350 req-0fa57aa3-652f-442c-a127-e6e82dcfdbb0 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updated VIF entry in instance network info cache for port 8472db86-c1ef-4c6a-a878-5951fa94e2e1. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:57:04 user nova-compute[75813]: DEBUG nova.network.neutron [req-83878d36-02a7-4fe7-b4af-24db17091350 req-0fa57aa3-652f-442c-a127-e6e82dcfdbb0 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updating instance_info_cache with network_info: [{"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83878d36-02a7-4fe7-b4af-24db17091350 req-0fa57aa3-652f-442c-a127-e6e82dcfdbb0 service nova] Releasing lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] No waiting events found dispatching network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:05 user nova-compute[75813]: WARNING nova.compute.manager [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received unexpected event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f for instance with vm_state active and task_state None.
Nov 15 12:57:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] No waiting events found dispatching network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:05 user nova-compute[75813]: WARNING nova.compute.manager [req-9c1fcf54-d637-4585-8171-efea7f388d0e req-7eb21a04-e5e4-40ed-83ce-75e1782c5e1b service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received unexpected event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f for instance with vm_state active and task_state None.
Nov 15 12:57:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-70d96625-9809-4258-95da-769dd7679691 req-c81d870d-858d-4db2-8bab-ce226b2c9df8 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-70d96625-9809-4258-95da-769dd7679691 req-c81d870d-858d-4db2-8bab-ce226b2c9df8 service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-70d96625-9809-4258-95da-769dd7679691 req-c81d870d-858d-4db2-8bab-ce226b2c9df8 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-70d96625-9809-4258-95da-769dd7679691 req-c81d870d-858d-4db2-8bab-ce226b2c9df8 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-70d96625-9809-4258-95da-769dd7679691 req-c81d870d-858d-4db2-8bab-ce226b2c9df8 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:05 user nova-compute[75813]: WARNING nova.compute.manager [req-70d96625-9809-4258-95da-769dd7679691 req-c81d870d-858d-4db2-8bab-ce226b2c9df8 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received unexpected event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with vm_state building and task_state spawning.
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:05 user nova-compute[75813]: INFO nova.compute.manager [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Terminating instance
Nov 15 12:57:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-68568cd0-14ec-4318-a5b3-fbb7e607def2 req-90b89a49-adbd-4a3b-9cf5-8fc3d5392f6d service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Received event network-vif-unplugged-d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-68568cd0-14ec-4318-a5b3-fbb7e607def2 req-90b89a49-adbd-4a3b-9cf5-8fc3d5392f6d service nova] Acquiring lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-68568cd0-14ec-4318-a5b3-fbb7e607def2 req-90b89a49-adbd-4a3b-9cf5-8fc3d5392f6d service nova] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-68568cd0-14ec-4318-a5b3-fbb7e607def2 req-90b89a49-adbd-4a3b-9cf5-8fc3d5392f6d service nova] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-68568cd0-14ec-4318-a5b3-fbb7e607def2 req-90b89a49-adbd-4a3b-9cf5-8fc3d5392f6d service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] No waiting events found dispatching network-vif-unplugged-d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-68568cd0-14ec-4318-a5b3-fbb7e607def2 req-90b89a49-adbd-4a3b-9cf5-8fc3d5392f6d service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Received event network-vif-unplugged-d6630471-bf54-4db0-9251-07ae85b91335 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:06 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Instance destroyed successfully.
Nov 15 12:57:06 user nova-compute[75813]: DEBUG nova.objects.instance [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'resources' on Instance uuid 4bf92268-8acd-4092-94ed-3ae2b85b4f8e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-634746722',display_name='tempest-AttachVolumeNegativeTest-server-634746722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-634746722',id=17,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9MQmgXoZPKDWbc20pbprJlFtMrz22D9wD2k8yW8lipaBrCdDdOGzn6tUyeRXaptw9X2601lWsjZKi4+pU6myhdA+6gINEV3mJF3BltwxBJAJIg5CAebFaAff+s+7OEXA==',key_name='tempest-keypair-282939471',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-3vx0dlch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:54:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=4bf92268-8acd-4092-94ed-3ae2b85b4f8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6630471-bf54-4db0-9251-07ae85b91335", "address": "fa:16:3e:c4:36:59", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6630471-bf", "ovs_interfaceid": "d6630471-bf54-4db0-9251-07ae85b91335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "d6630471-bf54-4db0-9251-07ae85b91335", "address": "fa:16:3e:c4:36:59", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6630471-bf", "ovs_interfaceid": "d6630471-bf54-4db0-9251-07ae85b91335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:36:59,bridge_name='br-int',has_traffic_filtering=True,id=d6630471-bf54-4db0-9251-07ae85b91335,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6630471-bf') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG os_vif [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:36:59,bridge_name='br-int',has_traffic_filtering=True,id=d6630471-bf54-4db0-9251-07ae85b91335,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6630471-bf') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6630471-bf, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7a5fa44-6ee4-4fad-a18a-7b297d08dd9d) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:06 user nova-compute[75813]: INFO os_vif [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:36:59,bridge_name='br-int',has_traffic_filtering=True,id=d6630471-bf54-4db0-9251-07ae85b91335,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6630471-bf')
Nov 15 12:57:06 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Deleting instance files /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e_del
Nov 15 12:57:06 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Deletion of /opt/stack/data/nova/instances/4bf92268-8acd-4092-94ed-3ae2b85b4f8e_del complete
Nov 15 12:57:06 user nova-compute[75813]: INFO nova.compute.manager [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 12:57:06 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:57:06 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-5038c493-83bc-4061-8ad9-440b3bb51710 req-33ac7f90-d7bf-4be6-bb91-ba63e04d4680 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5038c493-83bc-4061-8ad9-440b3bb51710 req-33ac7f90-d7bf-4be6-bb91-ba63e04d4680 service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5038c493-83bc-4061-8ad9-440b3bb51710 req-33ac7f90-d7bf-4be6-bb91-ba63e04d4680 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5038c493-83bc-4061-8ad9-440b3bb51710 req-33ac7f90-d7bf-4be6-bb91-ba63e04d4680 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-5038c493-83bc-4061-8ad9-440b3bb51710 req-33ac7f90-d7bf-4be6-bb91-ba63e04d4680 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:07 user nova-compute[75813]: WARNING nova.compute.manager [req-5038c493-83bc-4061-8ad9-440b3bb51710 req-33ac7f90-d7bf-4be6-bb91-ba63e04d4680 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received unexpected event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with vm_state building and task_state spawning.
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-8d00780a-be65-4223-acb4-4fbbc69cf93e req-568abb44-b4ad-4df1-bdcb-456d92786e77 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Received event network-vif-deleted-d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:07 user nova-compute[75813]: INFO nova.compute.manager [req-8d00780a-be65-4223-acb4-4fbbc69cf93e req-568abb44-b4ad-4df1-bdcb-456d92786e77 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Neutron deleted interface d6630471-bf54-4db0-9251-07ae85b91335; detaching it from the instance and deleting it from the info cache
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.network.neutron [req-8d00780a-be65-4223-acb4-4fbbc69cf93e req-568abb44-b4ad-4df1-bdcb-456d92786e77 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:07 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Took 1.25 seconds to deallocate network for instance.
Nov 15 12:57:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-8d00780a-be65-4223-acb4-4fbbc69cf93e req-568abb44-b4ad-4df1-bdcb-456d92786e77 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Detach interface failed, port_id=d6630471-bf54-4db0-9251-07ae85b91335, reason: Instance 4bf92268-8acd-4092-94ed-3ae2b85b4f8e could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:57:07 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance spawned successfully.
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:07 user nova-compute[75813]: INFO nova.compute.manager [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-c7a273e5-b60f-4a53-af55-eaa28d5e4558 req-ce31af7d-b00d-4307-8ce9-462a189c5209 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Received event network-vif-plugged-d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c7a273e5-b60f-4a53-af55-eaa28d5e4558 req-ce31af7d-b00d-4307-8ce9-462a189c5209 service nova] Acquiring lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c7a273e5-b60f-4a53-af55-eaa28d5e4558 req-ce31af7d-b00d-4307-8ce9-462a189c5209 service nova] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c7a273e5-b60f-4a53-af55-eaa28d5e4558 req-ce31af7d-b00d-4307-8ce9-462a189c5209 service nova] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-c7a273e5-b60f-4a53-af55-eaa28d5e4558 req-ce31af7d-b00d-4307-8ce9-462a189c5209 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] No waiting events found dispatching network-vif-plugged-d6630471-bf54-4db0-9251-07ae85b91335 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:07 user nova-compute[75813]: WARNING nova.compute.manager [req-c7a273e5-b60f-4a53-af55-eaa28d5e4558 req-ce31af7d-b00d-4307-8ce9-462a189c5209 service nova] [instance: 4bf92268-8acd-4092-94ed-3ae2b85b4f8e] Received unexpected event network-vif-plugged-d6630471-bf54-4db0-9251-07ae85b91335 for instance with vm_state deleted and task_state None.
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:57:07 user nova-compute[75813]: INFO nova.compute.manager [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Took 6.40 seconds to build instance.
Nov 15 12:57:07 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:57:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-52020fa1-58c4-433e-94c4-cf3702820990 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.528s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:08 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Deleted allocations for instance 4bf92268-8acd-4092-94ed-3ae2b85b4f8e
Nov 15 12:57:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7e364077-bc06-4fb1-9398-26500be21ffe tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "4bf92268-8acd-4092-94ed-3ae2b85b4f8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.706s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:57:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:19 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:57:19 user nova-compute[75813]: INFO nova.compute.claims [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Claim successful on node user
Nov 15 12:57:19 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:57:19 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:57:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:57:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:57:19 user nova-compute[75813]: DEBUG nova.network.neutron [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:57:19 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:57:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG nova.policy [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f3642a668cd4e998ffbaf8f76f5d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eaef11927a74bd4a8dfa8f6a11ab367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:57:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Creating image(s)
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "/opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "/opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "/opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.203s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk 1073741824" returned: 0 in 0.059s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Successfully created port: d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:57:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Cannot resize image /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Ensure instance console log exists: /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG nova.network.neutron [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Successfully updated port: d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquired lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG nova.network.neutron [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-2b5d2579-39bc-4ec5-83e6-120ac93a8c42 req-c4f7e60d-056a-4315-a978-340e4d8a1313 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-changed-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-2b5d2579-39bc-4ec5-83e6-120ac93a8c42 req-c4f7e60d-056a-4315-a978-340e4d8a1313 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Refreshing instance network info cache due to event network-changed-d38d4cbb-3312-4630-a9e2-27a4dadec958. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2b5d2579-39bc-4ec5-83e6-120ac93a8c42 req-c4f7e60d-056a-4315-a978-340e4d8a1313 service nova] Acquiring lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:57:21 user nova-compute[75813]: DEBUG nova.network.neutron [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.network.neutron [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updating instance_info_cache with network_info: [{"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Releasing lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.compute.manager [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Instance network_info: |[{"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2b5d2579-39bc-4ec5-83e6-120ac93a8c42 req-c4f7e60d-056a-4315-a978-340e4d8a1313 service nova] Acquired lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.network.neutron [req-2b5d2579-39bc-4ec5-83e6-120ac93a8c42 req-c4f7e60d-056a-4315-a978-340e4d8a1313 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Refreshing network info cache for port d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Start _get_guest_xml network_info=[{"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:57:22 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:57:22 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-850952693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-850952693',id=22,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqVs2iLbmwX7/vowP0VC4cDfMVoE7o+iBjs+PlvP8I1SdBilZWyP/O6U7deeJL9IG22ogmYjkpNi1UI64FWTxrk4u73gBCVAkow6+DTajJvUW/fQXviHhni4tmqSXqWoA==',key_name='tempest-keypair-1330676257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-kdv40ajl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=933c225a-9ff5-406b-9600-6a90e738810c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.objects.instance [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'pci_devices' on Instance uuid 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:57:22 user nova-compute[75813]:   <uuid>933c225a-9ff5-406b-9600-6a90e738810c</uuid>
Nov 15 12:57:22 user nova-compute[75813]:   <name>instance-00000016</name>
Nov 15 12:57:22 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:57:22 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:57:22 user nova-compute[75813]:   <metadata>
Nov 15 12:57:22 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:57:22 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:57:22 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-850952693</nova:name>
Nov 15 12:57:22 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:57:22</nova:creationTime>
Nov 15 12:57:22 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:57:22 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:57:22 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:57:22 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:57:22 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:57:22 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:57:22 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:57:22 user nova-compute[75813]:       <nova:owner>
Nov 15 12:57:22 user nova-compute[75813]:         <nova:user uuid="7f3642a668cd4e998ffbaf8f76f5d895">tempest-AttachVolumeShelveTestJSON-1167418523-project-member</nova:user>
Nov 15 12:57:22 user nova-compute[75813]:         <nova:project uuid="8eaef11927a74bd4a8dfa8f6a11ab367">tempest-AttachVolumeShelveTestJSON-1167418523</nova:project>
Nov 15 12:57:22 user nova-compute[75813]:       </nova:owner>
Nov 15 12:57:22 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:57:22 user nova-compute[75813]:       <nova:ports>
Nov 15 12:57:22 user nova-compute[75813]:         <nova:port uuid="d38d4cbb-3312-4630-a9e2-27a4dadec958">
Nov 15 12:57:22 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 12:57:22 user nova-compute[75813]:         </nova:port>
Nov 15 12:57:22 user nova-compute[75813]:       </nova:ports>
Nov 15 12:57:22 user nova-compute[75813]:     </nova:instance>
Nov 15 12:57:22 user nova-compute[75813]:   </metadata>
Nov 15 12:57:22 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:57:22 user nova-compute[75813]:     <system>
Nov 15 12:57:22 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:57:22 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:57:22 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:57:22 user nova-compute[75813]:       <entry name="serial">933c225a-9ff5-406b-9600-6a90e738810c</entry>
Nov 15 12:57:22 user nova-compute[75813]:       <entry name="uuid">933c225a-9ff5-406b-9600-6a90e738810c</entry>
Nov 15 12:57:22 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:57:22 user nova-compute[75813]:     </system>
Nov 15 12:57:22 user nova-compute[75813]:   </sysinfo>
Nov 15 12:57:22 user nova-compute[75813]:   <os>
Nov 15 12:57:22 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:57:22 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:57:22 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:57:22 user nova-compute[75813]:   </os>
Nov 15 12:57:22 user nova-compute[75813]:   <features>
Nov 15 12:57:22 user nova-compute[75813]:     <acpi/>
Nov 15 12:57:22 user nova-compute[75813]:     <apic/>
Nov 15 12:57:22 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:57:22 user nova-compute[75813]:   </features>
Nov 15 12:57:22 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:57:22 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:57:22 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:57:22 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:57:22 user nova-compute[75813]:   </clock>
Nov 15 12:57:22 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:57:22 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:57:22 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:57:22 user nova-compute[75813]:   </cpu>
Nov 15 12:57:22 user nova-compute[75813]:   <devices>
Nov 15 12:57:22 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:57:22 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:57:22 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk"/>
Nov 15 12:57:22 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:57:22 user nova-compute[75813]:     </disk>
Nov 15 12:57:22 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:57:22 user nova-compute[75813]:       <mac address="fa:16:3e:25:19:36"/>
Nov 15 12:57:22 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:57:22 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:57:22 user nova-compute[75813]:       <target dev="tapd38d4cbb-33"/>
Nov 15 12:57:22 user nova-compute[75813]:     </interface>
Nov 15 12:57:22 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:57:22 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/console.log" append="off"/>
Nov 15 12:57:22 user nova-compute[75813]:     </serial>
Nov 15 12:57:22 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:57:22 user nova-compute[75813]:     <video>
Nov 15 12:57:22 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:57:22 user nova-compute[75813]:     </video>
Nov 15 12:57:22 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:57:22 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:57:22 user nova-compute[75813]:     </rng>
Nov 15 12:57:22 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:57:22 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:57:22 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:57:22 user nova-compute[75813]:     </memballoon>
Nov 15 12:57:22 user nova-compute[75813]:   </devices>
Nov 15 12:57:22 user nova-compute[75813]: </domain>
Nov 15 12:57:22 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-850952693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-850952693',id=22,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqVs2iLbmwX7/vowP0VC4cDfMVoE7o+iBjs+PlvP8I1SdBilZWyP/O6U7deeJL9IG22ogmYjkpNi1UI64FWTxrk4u73gBCVAkow6+DTajJvUW/fQXviHhni4tmqSXqWoA==',key_name='tempest-keypair-1330676257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-kdv40ajl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=933c225a-9ff5-406b-9600-6a90e738810c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG os_vif [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2880f582-7143-55f2-9259-4c9c1b211241', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd38d4cbb-33, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd38d4cbb-33, col_values=(('qos', UUID('4f434776-3204-4949-98bd-56e501c9e24a')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd38d4cbb-33, col_values=(('external_ids', {'iface-id': 'd38d4cbb-3312-4630-a9e2-27a4dadec958', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:19:36', 'vm-uuid': '933c225a-9ff5-406b-9600-6a90e738810c'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:22 user nova-compute[75813]: INFO os_vif [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33')
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] No VIF found with MAC fa:16:3e:25:19:36, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.network.neutron [req-2b5d2579-39bc-4ec5-83e6-120ac93a8c42 req-c4f7e60d-056a-4315-a978-340e4d8a1313 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updated VIF entry in instance network info cache for port d38d4cbb-3312-4630-a9e2-27a4dadec958. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG nova.network.neutron [req-2b5d2579-39bc-4ec5-83e6-120ac93a8c42 req-c4f7e60d-056a-4315-a978-340e4d8a1313 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updating instance_info_cache with network_info: [{"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2b5d2579-39bc-4ec5-83e6-120ac93a8c42 req-c4f7e60d-056a-4315-a978-340e4d8a1313 service nova] Releasing lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG nova.objects.instance [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:23 user nova-compute[75813]: INFO nova.compute.manager [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attaching volume 330cbdf8-d1cf-4703-9e89-8af4824cd2f9 to /dev/vdb
Nov 15 12:57:23 user nova-compute[75813]: DEBUG os_brick.utils [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[82007c63-55a8-4d90-ba50-8b1dcb36c53e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fc3618-87a7-4c7d-a4cf-991098e49caa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[454df7c1-7606-414a-934d-afb8e8afab39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a4a784-80af-42c1-be89-fb73b216f90e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-f1a461cd-3b0c-4251-8905-9ee4d764de59 req-139e30a6-5ab1-4e8e-a1df-7a6ddc653099 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f1a461cd-3b0c-4251-8905-9ee4d764de59 req-139e30a6-5ab1-4e8e-a1df-7a6ddc653099 service nova] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f1a461cd-3b0c-4251-8905-9ee4d764de59 req-139e30a6-5ab1-4e8e-a1df-7a6ddc653099 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f1a461cd-3b0c-4251-8905-9ee4d764de59 req-139e30a6-5ab1-4e8e-a1df-7a6ddc653099 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-f1a461cd-3b0c-4251-8905-9ee4d764de59 req-139e30a6-5ab1-4e8e-a1df-7a6ddc653099 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] No waiting events found dispatching network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:23 user nova-compute[75813]: WARNING nova.compute.manager [req-f1a461cd-3b0c-4251-8905-9ee4d764de59 req-139e30a6-5ab1-4e8e-a1df-7a6ddc653099 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received unexpected event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 for instance with vm_state building and task_state spawning.
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:57:23 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:57:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec52d4c-3ab1-41b7-9652-cbbd3e281cc9]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG os_brick.utils [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:57:23 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updating existing volume attachment record: 09547ba9-fc15-447b-ba79-41d979f39dc9 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:57:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-47bc6dcf-f9d2-48b7-acfd-6e7929f2902f req-13856a0a-21da-4281-a528-bdf1837066a9 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-47bc6dcf-f9d2-48b7-acfd-6e7929f2902f req-13856a0a-21da-4281-a528-bdf1837066a9 service nova] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-47bc6dcf-f9d2-48b7-acfd-6e7929f2902f req-13856a0a-21da-4281-a528-bdf1837066a9 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-47bc6dcf-f9d2-48b7-acfd-6e7929f2902f req-13856a0a-21da-4281-a528-bdf1837066a9 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-47bc6dcf-f9d2-48b7-acfd-6e7929f2902f req-13856a0a-21da-4281-a528-bdf1837066a9 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] No waiting events found dispatching network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:26 user nova-compute[75813]: WARNING nova.compute.manager [req-47bc6dcf-f9d2-48b7-acfd-6e7929f2902f req-13856a0a-21da-4281-a528-bdf1837066a9 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received unexpected event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 for instance with vm_state building and task_state spawning.
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.compute.manager [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:57:26 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Instance spawned successfully.
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:26 user nova-compute[75813]: INFO nova.compute.manager [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 15 12:57:26 user nova-compute[75813]: DEBUG nova.compute.manager [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:57:26 user nova-compute[75813]: INFO nova.compute.manager [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Took 6.83 seconds to build instance.
Nov 15 12:57:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-caea2f96-66ec-4491-a53e-e0cda4847d3e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.933s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:28 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:57:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:28 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:57:28 user nova-compute[75813]: INFO nova.compute.claims [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Claim successful on node user
Nov 15 12:57:29 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:57:29 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:57:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG nova.policy [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07f52b120c2e46e2a8ca7eb83dafceca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '134cc574095942efb38b85068bc72bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:57:29 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Creating image(s)
Nov 15 12:57:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "/opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "/opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "/opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.214s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.214s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Successfully created port: cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk 1073741824" returned: 0 in 0.100s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.199s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Cannot resize image /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Ensure instance console log exists: /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Successfully updated port: cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquired lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG nova.compute.manager [req-e715928f-e0c2-4433-9f40-bfd0fff74598 req-41f268bc-a900-4e99-bb45-0a4acbb25505 service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Received event network-changed-cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG nova.compute.manager [req-e715928f-e0c2-4433-9f40-bfd0fff74598 req-41f268bc-a900-4e99-bb45-0a4acbb25505 service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Refreshing instance network info cache due to event network-changed-cea789d8-f924-42d5-be5b-e43e32d9d727. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e715928f-e0c2-4433-9f40-bfd0fff74598 req-41f268bc-a900-4e99-bb45-0a4acbb25505 service nova] Acquiring lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:57:30 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updating instance_info_cache with network_info: [{"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Releasing lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Instance network_info: |[{"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e715928f-e0c2-4433-9f40-bfd0fff74598 req-41f268bc-a900-4e99-bb45-0a4acbb25505 service nova] Acquired lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.network.neutron [req-e715928f-e0c2-4433-9f40-bfd0fff74598 req-41f268bc-a900-4e99-bb45-0a4acbb25505 service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Refreshing network info cache for port cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Start _get_guest_xml network_info=[{"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:57:31 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:57:31 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1726108945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1726108945',id=23,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-oq8j2qd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:57:29Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=70ddb35e-bc7c-4e18-8028-54496eef0cce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:51:17,bridge_name='br-int',has_traffic_filtering=True,id=cea789d8-f924-42d5-be5b-e43e32d9d727,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea789d8-f9') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.objects.instance [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'pci_devices' on Instance uuid 70ddb35e-bc7c-4e18-8028-54496eef0cce {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:57:31 user nova-compute[75813]:   <uuid>70ddb35e-bc7c-4e18-8028-54496eef0cce</uuid>
Nov 15 12:57:31 user nova-compute[75813]:   <name>instance-00000017</name>
Nov 15 12:57:31 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:57:31 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:57:31 user nova-compute[75813]:   <metadata>
Nov 15 12:57:31 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:57:31 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:57:31 user nova-compute[75813]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1726108945</nova:name>
Nov 15 12:57:31 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:57:31</nova:creationTime>
Nov 15 12:57:31 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:57:31 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:57:31 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:57:31 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:57:31 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:57:31 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:57:31 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:57:31 user nova-compute[75813]:       <nova:owner>
Nov 15 12:57:31 user nova-compute[75813]:         <nova:user uuid="07f52b120c2e46e2a8ca7eb83dafceca">tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member</nova:user>
Nov 15 12:57:31 user nova-compute[75813]:         <nova:project uuid="134cc574095942efb38b85068bc72bfe">tempest-ServerBootFromVolumeStableRescueTest-2006280819</nova:project>
Nov 15 12:57:31 user nova-compute[75813]:       </nova:owner>
Nov 15 12:57:31 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:57:31 user nova-compute[75813]:       <nova:ports>
Nov 15 12:57:31 user nova-compute[75813]:         <nova:port uuid="cea789d8-f924-42d5-be5b-e43e32d9d727">
Nov 15 12:57:31 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 12:57:31 user nova-compute[75813]:         </nova:port>
Nov 15 12:57:31 user nova-compute[75813]:       </nova:ports>
Nov 15 12:57:31 user nova-compute[75813]:     </nova:instance>
Nov 15 12:57:31 user nova-compute[75813]:   </metadata>
Nov 15 12:57:31 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:57:31 user nova-compute[75813]:     <system>
Nov 15 12:57:31 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:57:31 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:57:31 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:57:31 user nova-compute[75813]:       <entry name="serial">70ddb35e-bc7c-4e18-8028-54496eef0cce</entry>
Nov 15 12:57:31 user nova-compute[75813]:       <entry name="uuid">70ddb35e-bc7c-4e18-8028-54496eef0cce</entry>
Nov 15 12:57:31 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:57:31 user nova-compute[75813]:     </system>
Nov 15 12:57:31 user nova-compute[75813]:   </sysinfo>
Nov 15 12:57:31 user nova-compute[75813]:   <os>
Nov 15 12:57:31 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:57:31 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:57:31 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:57:31 user nova-compute[75813]:   </os>
Nov 15 12:57:31 user nova-compute[75813]:   <features>
Nov 15 12:57:31 user nova-compute[75813]:     <acpi/>
Nov 15 12:57:31 user nova-compute[75813]:     <apic/>
Nov 15 12:57:31 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:57:31 user nova-compute[75813]:   </features>
Nov 15 12:57:31 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:57:31 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:57:31 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:57:31 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:57:31 user nova-compute[75813]:   </clock>
Nov 15 12:57:31 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:57:31 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:57:31 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:57:31 user nova-compute[75813]:   </cpu>
Nov 15 12:57:31 user nova-compute[75813]:   <devices>
Nov 15 12:57:31 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:57:31 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:57:31 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk"/>
Nov 15 12:57:31 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:57:31 user nova-compute[75813]:     </disk>
Nov 15 12:57:31 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:57:31 user nova-compute[75813]:       <mac address="fa:16:3e:3b:51:17"/>
Nov 15 12:57:31 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:57:31 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:57:31 user nova-compute[75813]:       <target dev="tapcea789d8-f9"/>
Nov 15 12:57:31 user nova-compute[75813]:     </interface>
Nov 15 12:57:31 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:57:31 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/console.log" append="off"/>
Nov 15 12:57:31 user nova-compute[75813]:     </serial>
Nov 15 12:57:31 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:57:31 user nova-compute[75813]:     <video>
Nov 15 12:57:31 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:57:31 user nova-compute[75813]:     </video>
Nov 15 12:57:31 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:57:31 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:57:31 user nova-compute[75813]:     </rng>
Nov 15 12:57:31 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:57:31 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:57:31 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:57:31 user nova-compute[75813]:     </memballoon>
Nov 15 12:57:31 user nova-compute[75813]:   </devices>
Nov 15 12:57:31 user nova-compute[75813]: </domain>
Nov 15 12:57:31 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1726108945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1726108945',id=23,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-oq8j2qd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:57:29Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=70ddb35e-bc7c-4e18-8028-54496eef0cce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:51:17,bridge_name='br-int',has_traffic_filtering=True,id=cea789d8-f924-42d5-be5b-e43e32d9d727,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea789d8-f9') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG os_vif [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:51:17,bridge_name='br-int',has_traffic_filtering=True,id=cea789d8-f924-42d5-be5b-e43e32d9d727,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea789d8-f9') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf6ffeab-dda6-5064-8538-a2ee2b0ea244', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcea789d8-f9, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcea789d8-f9, col_values=(('qos', UUID('509f3220-4701-46fc-bc59-e2ff736ce565')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcea789d8-f9, col_values=(('external_ids', {'iface-id': 'cea789d8-f924-42d5-be5b-e43e32d9d727', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:51:17', 'vm-uuid': '70ddb35e-bc7c-4e18-8028-54496eef0cce'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:31 user nova-compute[75813]: INFO os_vif [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:51:17,bridge_name='br-int',has_traffic_filtering=True,id=cea789d8-f924-42d5-be5b-e43e32d9d727,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea789d8-f9')
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No VIF found with MAC fa:16:3e:3b:51:17, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.network.neutron [req-e715928f-e0c2-4433-9f40-bfd0fff74598 req-41f268bc-a900-4e99-bb45-0a4acbb25505 service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updated VIF entry in instance network info cache for port cea789d8-f924-42d5-be5b-e43e32d9d727. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.network.neutron [req-e715928f-e0c2-4433-9f40-bfd0fff74598 req-41f268bc-a900-4e99-bb45-0a4acbb25505 service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updating instance_info_cache with network_info: [{"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e715928f-e0c2-4433-9f40-bfd0fff74598 req-41f268bc-a900-4e99-bb45-0a4acbb25505 service nova] Releasing lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "9693ad51-4044-46be-a5dc-00db9bf198bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:31 user nova-compute[75813]: INFO nova.compute.manager [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Terminating instance
Nov 15 12:57:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received event network-vif-unplugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] Acquiring lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] No waiting events found dispatching network-vif-unplugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received event network-vif-unplugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] Acquiring lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] No waiting events found dispatching network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:32 user nova-compute[75813]: WARNING nova.compute.manager [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received unexpected event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 for instance with vm_state active and task_state deleting.
Nov 15 12:57:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] Acquiring lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] No waiting events found dispatching network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:32 user nova-compute[75813]: WARNING nova.compute.manager [req-d225affa-df1c-4f3f-8f55-7524d982c455 req-fa608d4f-44a4-4b86-a6d9-caf75d47f789 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received unexpected event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 for instance with vm_state active and task_state deleting.
Nov 15 12:57:32 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Instance destroyed successfully.
Nov 15 12:57:32 user nova-compute[75813]: DEBUG nova.objects.instance [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lazy-loading 'resources' on Instance uuid 9693ad51-4044-46be-a5dc-00db9bf198bb {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:55:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-81108389',display_name='tempest-VolumesAdminNegativeTest-server-81108389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-81108389',id=19,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:55:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='221ec165127e467a9131e2ff691429b1',ramdisk_id='',reservation_id='r-q831ivz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1498772195',owner_user_name='tempest-VolumesAdminNegativeTest-1498772195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:55:40Z,user_data=None,user_id='9fa6040843394b2fa38e29ff70e9d3ed',uuid=9693ad51-4044-46be-a5dc-00db9bf198bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "address": "fa:16:3e:e7:5b:70", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c275c19-2b", "ovs_interfaceid": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converting VIF {"id": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "address": "fa:16:3e:e7:5b:70", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c275c19-2b", "ovs_interfaceid": "0c275c19-2b0e-462b-a9ee-e953d881ce51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5b:70,bridge_name='br-int',has_traffic_filtering=True,id=0c275c19-2b0e-462b-a9ee-e953d881ce51,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c275c19-2b') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG os_vif [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5b:70,bridge_name='br-int',has_traffic_filtering=True,id=0c275c19-2b0e-462b-a9ee-e953d881ce51,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c275c19-2b') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c275c19-2b, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63926f5a-2f95-468f-8356-ba99f3814d95) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:32 user nova-compute[75813]: INFO os_vif [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5b:70,bridge_name='br-int',has_traffic_filtering=True,id=0c275c19-2b0e-462b-a9ee-e953d881ce51,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c275c19-2b')
Nov 15 12:57:32 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Deleting instance files /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb_del
Nov 15 12:57:32 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Deletion of /opt/stack/data/nova/instances/9693ad51-4044-46be-a5dc-00db9bf198bb_del complete
Nov 15 12:57:33 user nova-compute[75813]: INFO nova.compute.manager [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-3b8eec99-5910-43a0-aae9-ba46157afc69 req-6981b39e-eb42-43e6-a023-16b6b11fa51b service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Received event network-vif-plugged-cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3b8eec99-5910-43a0-aae9-ba46157afc69 req-6981b39e-eb42-43e6-a023-16b6b11fa51b service nova] Acquiring lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3b8eec99-5910-43a0-aae9-ba46157afc69 req-6981b39e-eb42-43e6-a023-16b6b11fa51b service nova] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3b8eec99-5910-43a0-aae9-ba46157afc69 req-6981b39e-eb42-43e6-a023-16b6b11fa51b service nova] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-3b8eec99-5910-43a0-aae9-ba46157afc69 req-6981b39e-eb42-43e6-a023-16b6b11fa51b service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] No waiting events found dispatching network-vif-plugged-cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:33 user nova-compute[75813]: WARNING nova.compute.manager [req-3b8eec99-5910-43a0-aae9-ba46157afc69 req-6981b39e-eb42-43e6-a023-16b6b11fa51b service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Received unexpected event network-vif-plugged-cea789d8-f924-42d5-be5b-e43e32d9d727 for instance with vm_state building and task_state spawning.
Nov 15 12:57:33 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:33 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Took 0.78 seconds to deallocate network for instance.
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HezEDShc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:57:33 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:57:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:57:33 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:57:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:57:33 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[edea08a7-d8a9-4244-93bb-ad6ee56b4b7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:57:33 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[de43831e-4b28-4006-bbe0-82837c8273df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9] added
Nov 15 12:57:33 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7512512b-e07a-4831-9628-f355565feff3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9640a9d0-140f-43e1-9475-356e7b3cdd14]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HezEDShc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HezEDShc" returned: 0 in 0.109s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[795d764c-7f21-460e-9ecf-b69fa01cb5af]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HezEDShc'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a92bb6-a069-4f65-ae10-c8ed57534e27]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ea34e8-b444-42b3-bf5f-564b82474988]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 12:57:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 12:57:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a78476-1509-42b2-be24-339ffaea03cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9, portal: 172.16.0.220,3260]
Nov 15 12:57:34 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9, portal: 172.16.0.220,3260] successful.
Nov 15 12:57:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cc8b0d-ec09-451c-8f25-c2583d820e05]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad2b061-a6c5-44e0-8b23-2ff672c7c475]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 12:57:34 user nova-compute[75813]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 (non-flash)
Nov 15 12:57:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 12:57:34 user nova-compute[75813]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 (non-flash)
Nov 15 12:57:34 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:57:34 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Deleted allocations for instance 9693ad51-4044-46be-a5dc-00db9bf198bb
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9387b681-4411-4cc2-a613-bb739ad8d98c]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HezEDShc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6b73ff1d-e160-45cc-95ae-a33b7321a30a tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.520s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] Acquiring lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] No waiting events found dispatching network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:34 user nova-compute[75813]: WARNING nova.compute.manager [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received unexpected event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 for instance with vm_state deleted and task_state None.
Nov 15 12:57:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received event network-vif-unplugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] Acquiring lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] No waiting events found dispatching network-vif-unplugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:34 user nova-compute[75813]: WARNING nova.compute.manager [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received unexpected event network-vif-unplugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 for instance with vm_state deleted and task_state None.
Nov 15 12:57:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] Acquiring lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] Lock "9693ad51-4044-46be-a5dc-00db9bf198bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] No waiting events found dispatching network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:34 user nova-compute[75813]: WARNING nova.compute.manager [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received unexpected event network-vif-plugged-0c275c19-2b0e-462b-a9ee-e953d881ce51 for instance with vm_state deleted and task_state None.
Nov 15 12:57:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-351cd2d0-b370-4394-8026-ad031c538ff3 req-e6482109-9cff-4af2-81b6-02f6af837530 service nova] [instance: 9693ad51-4044-46be-a5dc-00db9bf198bb] Received event network-vif-deleted-0c275c19-2b0e-462b-a9ee-e953d881ce51 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26463313166383032', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463313166383032', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.objects.instance [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:57:35 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:57:35 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 12:57:35 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:57:35 user nova-compute[75813]:   <serial>330cbdf8-d1cf-4703-9e89-8af4824cd2f9</serial>
Nov 15 12:57:35 user nova-compute[75813]: </disk>
Nov 15 12:57:35 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-d8bcd6d3-5ede-4c50-ad5a-55ef012e6a6d req-2635cab7-c223-45ed-8e53-3e846d459d80 service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Received event network-vif-plugged-cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d8bcd6d3-5ede-4c50-ad5a-55ef012e6a6d req-2635cab7-c223-45ed-8e53-3e846d459d80 service nova] Acquiring lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d8bcd6d3-5ede-4c50-ad5a-55ef012e6a6d req-2635cab7-c223-45ed-8e53-3e846d459d80 service nova] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d8bcd6d3-5ede-4c50-ad5a-55ef012e6a6d req-2635cab7-c223-45ed-8e53-3e846d459d80 service nova] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-d8bcd6d3-5ede-4c50-ad5a-55ef012e6a6d req-2635cab7-c223-45ed-8e53-3e846d459d80 service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] No waiting events found dispatching network-vif-plugged-cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:35 user nova-compute[75813]: WARNING nova.compute.manager [req-d8bcd6d3-5ede-4c50-ad5a-55ef012e6a6d req-2635cab7-c223-45ed-8e53-3e846d459d80 service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Received unexpected event network-vif-plugged-cea789d8-f924-42d5-be5b-e43e32d9d727 for instance with vm_state building and task_state spawning.
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:57:35 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Instance spawned successfully.
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:57:35 user nova-compute[75813]: INFO nova.compute.manager [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] No VIF found with MAC fa:16:3e:a5:07:30, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:57:35 user nova-compute[75813]: INFO nova.compute.manager [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Took 7.11 seconds to build instance.
Nov 15 12:57:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9319e332-4e05-443d-8e24-9723e418df88 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.252s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fd211776-afe2-4b5b-8d4c-84d634a220e1 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.236s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:38 user nova-compute[75813]: INFO nova.compute.manager [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Detaching volume 330cbdf8-d1cf-4703-9e89-8af4824cd2f9
Nov 15 12:57:38 user nova-compute[75813]: INFO nova.virt.block_device [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Attempting to driver detach volume 330cbdf8-d1cf-4703-9e89-8af4824cd2f9 from mountpoint /dev/vdb
Nov 15 12:57:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Attempting to detach device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 12:57:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:57:38 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:57:38 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 12:57:38 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:57:38 user nova-compute[75813]:   <serial>330cbdf8-d1cf-4703-9e89-8af4824cd2f9</serial>
Nov 15 12:57:38 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:57:38 user nova-compute[75813]: </disk>
Nov 15 12:57:38 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:57:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Successfully detached device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the persistent domain config.
Nov 15 12:57:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45154992-3213-43fa-89dc-d433f57ae978 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 12:57:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 12:57:38 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:57:38 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 12:57:38 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:57:38 user nova-compute[75813]:   <serial>330cbdf8-d1cf-4703-9e89-8af4824cd2f9</serial>
Nov 15 12:57:38 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 12:57:38 user nova-compute[75813]: </disk>
Nov 15 12:57:38 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 12:57:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 12:57:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:43 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:57:43 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:57:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:57:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 12:57:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:57:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:57:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:57:43 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:57:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updating instance_info_cache with network_info: [{"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-45154992-3213-43fa-89dc-d433f57ae978" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:57:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:57:44 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:57:44 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:57:44 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:57:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:57:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:57:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:57:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:57:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:57:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:51 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:57:51 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8009MB free_disk=25.403705596923828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 45154992-3213-43fa-89dc-d433f57ae978 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance be6a3a9f-c85c-4de8-b035-a4bead582c96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 933c225a-9ff5-406b-9600-6a90e738810c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:57:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:54 user nova-compute[75813]: DEBUG nova.compute.manager [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:57:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:57:54 user nova-compute[75813]: INFO nova.compute.claims [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Claim successful on node user
Nov 15 12:57:55 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG nova.network.neutron [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:57:55 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:57:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG nova.policy [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2b3f74a69954ecf8d5cce188f5fc043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ae639fa3444ba0be3d480b8572a0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:57:55 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Creating image(s)
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "/opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "/opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "/opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.165s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk 1073741824" returned: 0 in 0.053s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG nova.network.neutron [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Successfully created port: 47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Cannot resize image /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Ensure instance console log exists: /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG nova.network.neutron [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Successfully updated port: 47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquired lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG nova.network.neutron [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG nova.network.neutron [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-b28a9352-d02b-4b82-b8a7-d7d1ec6a21ed req-06360c8e-a07b-4d26-aaeb-36ecc6b76ac0 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received event network-changed-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-b28a9352-d02b-4b82-b8a7-d7d1ec6a21ed req-06360c8e-a07b-4d26-aaeb-36ecc6b76ac0 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Refreshing instance network info cache due to event network-changed-47f90629-6062-435c-82c7-44fb6630327c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:57:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b28a9352-d02b-4b82-b8a7-d7d1ec6a21ed req-06360c8e-a07b-4d26-aaeb-36ecc6b76ac0 service nova] Acquiring lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.network.neutron [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updating instance_info_cache with network_info: [{"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Releasing lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.compute.manager [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Instance network_info: |[{"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b28a9352-d02b-4b82-b8a7-d7d1ec6a21ed req-06360c8e-a07b-4d26-aaeb-36ecc6b76ac0 service nova] Acquired lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.network.neutron [req-b28a9352-d02b-4b82-b8a7-d7d1ec6a21ed req-06360c8e-a07b-4d26-aaeb-36ecc6b76ac0 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Refreshing network info cache for port 47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Start _get_guest_xml network_info=[{"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:57:57 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:57:57 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1103046064',display_name='tempest-ServerActionsTestOtherA-server-1103046064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1103046064',id=24,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVScCZLXI8rlN2zoy2tMpAv6grzq+Q7BUD3jx/c9Ws+QNGWvOGcy9SrrC2M21ruqsJkGVx6GSsSkIbkFK6Q0lAtOU+eEFXMzxHts/+TJKb69Xyco0mKWaJkDc6A3DpPzg==',key_name='tempest-keypair-21661059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-3m4iu18e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=2153a37a-4973-4008-b20c-1bd03dbc39c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:6a:6f,bridge_name='br-int',has_traffic_filtering=True,id=47f90629-6062-435c-82c7-44fb6630327c,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47f90629-60') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.objects.instance [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'pci_devices' on Instance uuid 2153a37a-4973-4008-b20c-1bd03dbc39c1 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:57:57 user nova-compute[75813]:   <uuid>2153a37a-4973-4008-b20c-1bd03dbc39c1</uuid>
Nov 15 12:57:57 user nova-compute[75813]:   <name>instance-00000018</name>
Nov 15 12:57:57 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:57:57 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:57:57 user nova-compute[75813]:   <metadata>
Nov 15 12:57:57 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:57:57 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:57:57 user nova-compute[75813]:       <nova:name>tempest-ServerActionsTestOtherA-server-1103046064</nova:name>
Nov 15 12:57:57 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:57:57</nova:creationTime>
Nov 15 12:57:57 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:57:57 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:57:57 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:57:57 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:57:57 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:57:57 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:57:57 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:57:57 user nova-compute[75813]:       <nova:owner>
Nov 15 12:57:57 user nova-compute[75813]:         <nova:user uuid="c2b3f74a69954ecf8d5cce188f5fc043">tempest-ServerActionsTestOtherA-1826218173-project-member</nova:user>
Nov 15 12:57:57 user nova-compute[75813]:         <nova:project uuid="76ae639fa3444ba0be3d480b8572a0e6">tempest-ServerActionsTestOtherA-1826218173</nova:project>
Nov 15 12:57:57 user nova-compute[75813]:       </nova:owner>
Nov 15 12:57:57 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:57:57 user nova-compute[75813]:       <nova:ports>
Nov 15 12:57:57 user nova-compute[75813]:         <nova:port uuid="47f90629-6062-435c-82c7-44fb6630327c">
Nov 15 12:57:57 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 12:57:57 user nova-compute[75813]:         </nova:port>
Nov 15 12:57:57 user nova-compute[75813]:       </nova:ports>
Nov 15 12:57:57 user nova-compute[75813]:     </nova:instance>
Nov 15 12:57:57 user nova-compute[75813]:   </metadata>
Nov 15 12:57:57 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:57:57 user nova-compute[75813]:     <system>
Nov 15 12:57:57 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:57:57 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:57:57 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:57:57 user nova-compute[75813]:       <entry name="serial">2153a37a-4973-4008-b20c-1bd03dbc39c1</entry>
Nov 15 12:57:57 user nova-compute[75813]:       <entry name="uuid">2153a37a-4973-4008-b20c-1bd03dbc39c1</entry>
Nov 15 12:57:57 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:57:57 user nova-compute[75813]:     </system>
Nov 15 12:57:57 user nova-compute[75813]:   </sysinfo>
Nov 15 12:57:57 user nova-compute[75813]:   <os>
Nov 15 12:57:57 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:57:57 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:57:57 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:57:57 user nova-compute[75813]:   </os>
Nov 15 12:57:57 user nova-compute[75813]:   <features>
Nov 15 12:57:57 user nova-compute[75813]:     <acpi/>
Nov 15 12:57:57 user nova-compute[75813]:     <apic/>
Nov 15 12:57:57 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:57:57 user nova-compute[75813]:   </features>
Nov 15 12:57:57 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:57:57 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:57:57 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:57:57 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:57:57 user nova-compute[75813]:   </clock>
Nov 15 12:57:57 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:57:57 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:57:57 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:57:57 user nova-compute[75813]:   </cpu>
Nov 15 12:57:57 user nova-compute[75813]:   <devices>
Nov 15 12:57:57 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:57:57 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:57:57 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk"/>
Nov 15 12:57:57 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:57:57 user nova-compute[75813]:     </disk>
Nov 15 12:57:57 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:57:57 user nova-compute[75813]:       <mac address="fa:16:3e:9d:6a:6f"/>
Nov 15 12:57:57 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:57:57 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:57:57 user nova-compute[75813]:       <target dev="tap47f90629-60"/>
Nov 15 12:57:57 user nova-compute[75813]:     </interface>
Nov 15 12:57:57 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:57:57 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/console.log" append="off"/>
Nov 15 12:57:57 user nova-compute[75813]:     </serial>
Nov 15 12:57:57 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:57:57 user nova-compute[75813]:     <video>
Nov 15 12:57:57 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:57:57 user nova-compute[75813]:     </video>
Nov 15 12:57:57 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:57:57 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:57:57 user nova-compute[75813]:     </rng>
Nov 15 12:57:57 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:57:57 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:57:57 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:57:57 user nova-compute[75813]:     </memballoon>
Nov 15 12:57:57 user nova-compute[75813]:   </devices>
Nov 15 12:57:57 user nova-compute[75813]: </domain>
Nov 15 12:57:57 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1103046064',display_name='tempest-ServerActionsTestOtherA-server-1103046064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1103046064',id=24,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVScCZLXI8rlN2zoy2tMpAv6grzq+Q7BUD3jx/c9Ws+QNGWvOGcy9SrrC2M21ruqsJkGVx6GSsSkIbkFK6Q0lAtOU+eEFXMzxHts/+TJKb69Xyco0mKWaJkDc6A3DpPzg==',key_name='tempest-keypair-21661059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-3m4iu18e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=2153a37a-4973-4008-b20c-1bd03dbc39c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:6a:6f,bridge_name='br-int',has_traffic_filtering=True,id=47f90629-6062-435c-82c7-44fb6630327c,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47f90629-60') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG os_vif [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:6a:6f,bridge_name='br-int',has_traffic_filtering=True,id=47f90629-6062-435c-82c7-44fb6630327c,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47f90629-60') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fc357d2-078f-5921-b724-e359fc1b249e', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47f90629-60, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47f90629-60, col_values=(('qos', UUID('2a1a984c-af4a-4466-8f53-fe02616d09dd')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47f90629-60, col_values=(('external_ids', {'iface-id': '47f90629-6062-435c-82c7-44fb6630327c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:6a:6f', 'vm-uuid': '2153a37a-4973-4008-b20c-1bd03dbc39c1'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:57 user nova-compute[75813]: INFO os_vif [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:6a:6f,bridge_name='br-int',has_traffic_filtering=True,id=47f90629-6062-435c-82c7-44fb6630327c,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47f90629-60')
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No VIF found with MAC fa:16:3e:9d:6a:6f, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.network.neutron [req-b28a9352-d02b-4b82-b8a7-d7d1ec6a21ed req-06360c8e-a07b-4d26-aaeb-36ecc6b76ac0 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updated VIF entry in instance network info cache for port 47f90629-6062-435c-82c7-44fb6630327c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG nova.network.neutron [req-b28a9352-d02b-4b82-b8a7-d7d1ec6a21ed req-06360c8e-a07b-4d26-aaeb-36ecc6b76ac0 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updating instance_info_cache with network_info: [{"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:57:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b28a9352-d02b-4b82-b8a7-d7d1ec6a21ed req-06360c8e-a07b-4d26-aaeb-36ecc6b76ac0 service nova] Releasing lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:57:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-32f28168-9e5d-474d-b51f-bce9b9b91eda req-6ae362b2-14de-4758-aa3b-3684d2c5692c service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received event network-vif-plugged-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:57:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-32f28168-9e5d-474d-b51f-bce9b9b91eda req-6ae362b2-14de-4758-aa3b-3684d2c5692c service nova] Acquiring lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-32f28168-9e5d-474d-b51f-bce9b9b91eda req-6ae362b2-14de-4758-aa3b-3684d2c5692c service nova] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-32f28168-9e5d-474d-b51f-bce9b9b91eda req-6ae362b2-14de-4758-aa3b-3684d2c5692c service nova] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-32f28168-9e5d-474d-b51f-bce9b9b91eda req-6ae362b2-14de-4758-aa3b-3684d2c5692c service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] No waiting events found dispatching network-vif-plugged-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:57:58 user nova-compute[75813]: WARNING nova.compute.manager [req-32f28168-9e5d-474d-b51f-bce9b9b91eda req-6ae362b2-14de-4758-aa3b-3684d2c5692c service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received unexpected event network-vif-plugged-47f90629-6062-435c-82c7-44fb6630327c for instance with vm_state building and task_state spawning.
Nov 15 12:57:59 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45154992-3213-43fa-89dc-d433f57ae978 is timed out.
Nov 15 12:57:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Successfully detached device vdb from instance 45154992-3213-43fa-89dc-d433f57ae978 from the live domain config.
Nov 15 12:57:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HezEDShc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:57:59 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d67df2-a673-4831-9325-07df2b724cea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:57:59 user nova-compute[75813]: No targets found.
Nov 15 12:57:59 user nova-compute[75813]: iSNS:
Nov 15 12:57:59 user nova-compute[75813]: No targets found.
Nov 15 12:57:59 user nova-compute[75813]: STATIC:
Nov 15 12:57:59 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9
Nov 15 12:57:59 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:57:59 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:57:59 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d
Nov 15 12:57:59 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:57:59 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:57:59 user nova-compute[75813]: FIRMWARE:
Nov 15 12:57:59 user nova-compute[75813]: No targets found.
Nov 15 12:57:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:57:59 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:57:59 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ba17c6-7893-4ccb-9497-6cf356dc6880]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c76887-a216-4204-b572-b42d7e2fcda1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 12:57:59 user nova-compute[75813]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 (non-flash)
Nov 15 12:57:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 12:57:59 user nova-compute[75813]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 (non-flash)
Nov 15 12:57:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550089120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9'): ({'sdc'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Removing single pathed devices sdc {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[88948407-b23f-40c5-9bbf-6006c3d4e3a1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d825b4da-1ac9-46c4-b9bd-1ec39021a444]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Flushing IO for device /dev/sdc {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49584d2-ff35-424a-bafc-e5e385d6ffc4]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[260ae766-f37d-4855-abe2-c0eb57cfbc1d]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5e3504-f1a1-4b70-b6ae-7e42453a1490]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[524d207d-0d0e-4a1b-93b6-45dcf425d145]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9, portal: 172.16.0.220,3260]
Nov 15 12:57:59 user nova-compute[75813]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9, portal: 172.16.0.220,3260] successful.
Nov 15 12:57:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330cbdf8-d1cf-4703-9e89-8af4824cd2f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d5fd8b-dbed-476f-aac8-6fe3b8ea6e6e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] <== disconnect_volume: return (295ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "0433b01f-5533-4902-bba4-41d47a3d394d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:57:59 user nova-compute[75813]: INFO nova.compute.claims [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Claim successful on node user
Nov 15 12:57:59 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:57:59 user nova-compute[75813]: DEBUG nova.network.neutron [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:58:00 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:58:00 user nova-compute[75813]: DEBUG nova.compute.manager [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG nova.objects.instance [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'flavor' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG nova.policy [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66e8cb4b92ee40b9875ac675ec63b982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb2a7b27b904d639b7df886781d587f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-425c268d-92e8-4ae7-8654-2caf4a7d9c6a tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.639s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG nova.compute.manager [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:58:00 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Creating image(s)
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "/opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "/opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "/opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.367s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk 1073741824" returned: 0 in 0.129s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.501s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG nova.network.neutron [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Successfully created port: 9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG nova.compute.manager [req-bb0324e5-a3a7-4eb9-b9e3-95f55dfb2112 req-6b4a8632-8290-4ca3-ad20-e8ce5e38f608 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received event network-vif-plugged-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bb0324e5-a3a7-4eb9-b9e3-95f55dfb2112 req-6b4a8632-8290-4ca3-ad20-e8ce5e38f608 service nova] Acquiring lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bb0324e5-a3a7-4eb9-b9e3-95f55dfb2112 req-6b4a8632-8290-4ca3-ad20-e8ce5e38f608 service nova] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bb0324e5-a3a7-4eb9-b9e3-95f55dfb2112 req-6b4a8632-8290-4ca3-ad20-e8ce5e38f608 service nova] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:00 user nova-compute[75813]: DEBUG nova.compute.manager [req-bb0324e5-a3a7-4eb9-b9e3-95f55dfb2112 req-6b4a8632-8290-4ca3-ad20-e8ce5e38f608 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] No waiting events found dispatching network-vif-plugged-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:58:00 user nova-compute[75813]: WARNING nova.compute.manager [req-bb0324e5-a3a7-4eb9-b9e3-95f55dfb2112 req-6b4a8632-8290-4ca3-ad20-e8ce5e38f608 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received unexpected event network-vif-plugged-47f90629-6062-435c-82c7-44fb6630327c for instance with vm_state building and task_state spawning.
Nov 15 12:58:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.166s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:58:01 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Instance spawned successfully.
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Cannot resize image /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Ensure instance console log exists: /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:01 user nova-compute[75813]: INFO nova.compute.manager [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:58:01 user nova-compute[75813]: INFO nova.compute.manager [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Took 6.37 seconds to build instance.
Nov 15 12:58:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-db11802c-6035-4d26-a144-428621f77068 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.481s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Successfully updated port: 9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "refresh_cache-0433b01f-5533-4902-bba4-41d47a3d394d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquired lock "refresh_cache-0433b01f-5533-4902-bba4-41d47a3d394d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Updating instance_info_cache with network_info: [{"id": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "address": "fa:16:3e:f2:6f:97", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ced7d59-ee", "ovs_interfaceid": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Releasing lock "refresh_cache-0433b01f-5533-4902-bba4-41d47a3d394d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Instance network_info: |[{"id": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "address": "fa:16:3e:f2:6f:97", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ced7d59-ee", "ovs_interfaceid": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Start _get_guest_xml network_info=[{"id": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "address": "fa:16:3e:f2:6f:97", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ced7d59-ee", "ovs_interfaceid": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:58:01 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:58:01 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2070014061',display_name='tempest-AttachVolumeNegativeTest-server-2070014061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2070014061',id=25,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeD/TqCfG/oOgf6xjcm8atBCjg+TwMuruS42zwMUwa+Ofjp7M3U6TC6ybx4l7GntqC9M8SFXxySrLmO0CEB9PNDYnnvEnnnp3+OAh8qyRsOXmgDXtv9Jcbm5P5zmyzhdg==',key_name='tempest-keypair-982632132',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-u1gfys8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=0433b01f-5533-4902-bba4-41d47a3d394d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "address": "fa:16:3e:f2:6f:97", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ced7d59-ee", "ovs_interfaceid": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "address": "fa:16:3e:f2:6f:97", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ced7d59-ee", "ovs_interfaceid": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=9ced7d59-eed0-45d0-bcc6-acd2a842c921,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ced7d59-ee') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.objects.instance [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'pci_devices' on Instance uuid 0433b01f-5533-4902-bba4-41d47a3d394d {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:58:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:58:01 user nova-compute[75813]:   <uuid>0433b01f-5533-4902-bba4-41d47a3d394d</uuid>
Nov 15 12:58:01 user nova-compute[75813]:   <name>instance-00000019</name>
Nov 15 12:58:01 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:58:01 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:58:01 user nova-compute[75813]:   <metadata>
Nov 15 12:58:01 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:58:01 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:58:01 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2070014061</nova:name>
Nov 15 12:58:01 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:58:01</nova:creationTime>
Nov 15 12:58:01 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:58:01 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:58:01 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:58:01 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:58:01 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:58:01 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:58:01 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:58:01 user nova-compute[75813]:       <nova:owner>
Nov 15 12:58:01 user nova-compute[75813]:         <nova:user uuid="66e8cb4b92ee40b9875ac675ec63b982">tempest-AttachVolumeNegativeTest-1316863353-project-member</nova:user>
Nov 15 12:58:01 user nova-compute[75813]:         <nova:project uuid="9cb2a7b27b904d639b7df886781d587f">tempest-AttachVolumeNegativeTest-1316863353</nova:project>
Nov 15 12:58:01 user nova-compute[75813]:       </nova:owner>
Nov 15 12:58:01 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:58:01 user nova-compute[75813]:       <nova:ports>
Nov 15 12:58:01 user nova-compute[75813]:         <nova:port uuid="9ced7d59-eed0-45d0-bcc6-acd2a842c921">
Nov 15 12:58:01 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 12:58:01 user nova-compute[75813]:         </nova:port>
Nov 15 12:58:01 user nova-compute[75813]:       </nova:ports>
Nov 15 12:58:01 user nova-compute[75813]:     </nova:instance>
Nov 15 12:58:01 user nova-compute[75813]:   </metadata>
Nov 15 12:58:01 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:58:01 user nova-compute[75813]:     <system>
Nov 15 12:58:01 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:58:01 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:58:01 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:58:01 user nova-compute[75813]:       <entry name="serial">0433b01f-5533-4902-bba4-41d47a3d394d</entry>
Nov 15 12:58:01 user nova-compute[75813]:       <entry name="uuid">0433b01f-5533-4902-bba4-41d47a3d394d</entry>
Nov 15 12:58:01 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:58:01 user nova-compute[75813]:     </system>
Nov 15 12:58:01 user nova-compute[75813]:   </sysinfo>
Nov 15 12:58:01 user nova-compute[75813]:   <os>
Nov 15 12:58:01 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:58:01 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:58:01 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:58:01 user nova-compute[75813]:   </os>
Nov 15 12:58:01 user nova-compute[75813]:   <features>
Nov 15 12:58:01 user nova-compute[75813]:     <acpi/>
Nov 15 12:58:01 user nova-compute[75813]:     <apic/>
Nov 15 12:58:01 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:58:01 user nova-compute[75813]:   </features>
Nov 15 12:58:01 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:58:01 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:58:01 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:58:01 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:58:01 user nova-compute[75813]:   </clock>
Nov 15 12:58:01 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:58:01 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:58:01 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:58:01 user nova-compute[75813]:   </cpu>
Nov 15 12:58:01 user nova-compute[75813]:   <devices>
Nov 15 12:58:01 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:58:01 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:58:01 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk"/>
Nov 15 12:58:01 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:58:01 user nova-compute[75813]:     </disk>
Nov 15 12:58:01 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:58:01 user nova-compute[75813]:       <mac address="fa:16:3e:f2:6f:97"/>
Nov 15 12:58:01 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:58:01 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:58:01 user nova-compute[75813]:       <target dev="tap9ced7d59-ee"/>
Nov 15 12:58:01 user nova-compute[75813]:     </interface>
Nov 15 12:58:01 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:58:01 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/console.log" append="off"/>
Nov 15 12:58:01 user nova-compute[75813]:     </serial>
Nov 15 12:58:01 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:58:01 user nova-compute[75813]:     <video>
Nov 15 12:58:01 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:58:01 user nova-compute[75813]:     </video>
Nov 15 12:58:01 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:58:01 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:58:01 user nova-compute[75813]:     </rng>
Nov 15 12:58:01 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:58:01 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:58:01 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:58:01 user nova-compute[75813]:     </memballoon>
Nov 15 12:58:01 user nova-compute[75813]:   </devices>
Nov 15 12:58:01 user nova-compute[75813]: </domain>
Nov 15 12:58:01 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2070014061',display_name='tempest-AttachVolumeNegativeTest-server-2070014061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2070014061',id=25,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeD/TqCfG/oOgf6xjcm8atBCjg+TwMuruS42zwMUwa+Ofjp7M3U6TC6ybx4l7GntqC9M8SFXxySrLmO0CEB9PNDYnnvEnnnp3+OAh8qyRsOXmgDXtv9Jcbm5P5zmyzhdg==',key_name='tempest-keypair-982632132',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-u1gfys8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=0433b01f-5533-4902-bba4-41d47a3d394d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "address": "fa:16:3e:f2:6f:97", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ced7d59-ee", "ovs_interfaceid": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "address": "fa:16:3e:f2:6f:97", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ced7d59-ee", "ovs_interfaceid": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=9ced7d59-eed0-45d0-bcc6-acd2a842c921,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ced7d59-ee') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG os_vif [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=9ced7d59-eed0-45d0-bcc6-acd2a842c921,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ced7d59-ee') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '534e1bd9-ded4-5378-8a51-2bfbfa8db55d', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ced7d59-ee, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ced7d59-ee, col_values=(('qos', UUID('7c2c43a6-c979-4602-bdbe-46ec11515941')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ced7d59-ee, col_values=(('external_ids', {'iface-id': '9ced7d59-eed0-45d0-bcc6-acd2a842c921', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:6f:97', 'vm-uuid': '0433b01f-5533-4902-bba4-41d47a3d394d'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:02 user nova-compute[75813]: INFO os_vif [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=9ced7d59-eed0-45d0-bcc6-acd2a842c921,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ced7d59-ee')
Nov 15 12:58:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:58:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No VIF found with MAC fa:16:3e:f2:6f:97, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-d0568ba5-5e9a-4d14-a870-43ca846301d2 req-6f9a0fa3-59b4-4639-be79-d35ef09a75c3 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Received event network-changed-9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-d0568ba5-5e9a-4d14-a870-43ca846301d2 req-6f9a0fa3-59b4-4639-be79-d35ef09a75c3 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Refreshing instance network info cache due to event network-changed-9ced7d59-eed0-45d0-bcc6-acd2a842c921. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d0568ba5-5e9a-4d14-a870-43ca846301d2 req-6f9a0fa3-59b4-4639-be79-d35ef09a75c3 service nova] Acquiring lock "refresh_cache-0433b01f-5533-4902-bba4-41d47a3d394d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d0568ba5-5e9a-4d14-a870-43ca846301d2 req-6f9a0fa3-59b4-4639-be79-d35ef09a75c3 service nova] Acquired lock "refresh_cache-0433b01f-5533-4902-bba4-41d47a3d394d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-d0568ba5-5e9a-4d14-a870-43ca846301d2 req-6f9a0fa3-59b4-4639-be79-d35ef09a75c3 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Refreshing network info cache for port 9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-d0568ba5-5e9a-4d14-a870-43ca846301d2 req-6f9a0fa3-59b4-4639-be79-d35ef09a75c3 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Updated VIF entry in instance network info cache for port 9ced7d59-eed0-45d0-bcc6-acd2a842c921. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-d0568ba5-5e9a-4d14-a870-43ca846301d2 req-6f9a0fa3-59b4-4639-be79-d35ef09a75c3 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Updating instance_info_cache with network_info: [{"id": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "address": "fa:16:3e:f2:6f:97", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ced7d59-ee", "ovs_interfaceid": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d0568ba5-5e9a-4d14-a870-43ca846301d2 req-6f9a0fa3-59b4-4639-be79-d35ef09a75c3 service nova] Releasing lock "refresh_cache-0433b01f-5533-4902-bba4-41d47a3d394d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-5a3f3a2b-5417-4e1d-b57c-5837300d313e req-34487a22-5d3f-49bc-91e7-9b9aa30978e3 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Received event network-vif-plugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5a3f3a2b-5417-4e1d-b57c-5837300d313e req-34487a22-5d3f-49bc-91e7-9b9aa30978e3 service nova] Acquiring lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5a3f3a2b-5417-4e1d-b57c-5837300d313e req-34487a22-5d3f-49bc-91e7-9b9aa30978e3 service nova] Lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5a3f3a2b-5417-4e1d-b57c-5837300d313e req-34487a22-5d3f-49bc-91e7-9b9aa30978e3 service nova] Lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-5a3f3a2b-5417-4e1d-b57c-5837300d313e req-34487a22-5d3f-49bc-91e7-9b9aa30978e3 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] No waiting events found dispatching network-vif-plugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:58:03 user nova-compute[75813]: WARNING nova.compute.manager [req-5a3f3a2b-5417-4e1d-b57c-5837300d313e req-34487a22-5d3f-49bc-91e7-9b9aa30978e3 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Received unexpected event network-vif-plugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 for instance with vm_state building and task_state spawning.
Nov 15 12:58:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:58:05 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Instance spawned successfully.
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:58:05 user nova-compute[75813]: INFO nova.compute.manager [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-b91d631e-52c1-464d-b01b-2ff6d954e190 req-50b65311-b18c-42c2-9aeb-cd0d30b0f0f1 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Received event network-vif-plugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b91d631e-52c1-464d-b01b-2ff6d954e190 req-50b65311-b18c-42c2-9aeb-cd0d30b0f0f1 service nova] Acquiring lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b91d631e-52c1-464d-b01b-2ff6d954e190 req-50b65311-b18c-42c2-9aeb-cd0d30b0f0f1 service nova] Lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b91d631e-52c1-464d-b01b-2ff6d954e190 req-50b65311-b18c-42c2-9aeb-cd0d30b0f0f1 service nova] Lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-b91d631e-52c1-464d-b01b-2ff6d954e190 req-50b65311-b18c-42c2-9aeb-cd0d30b0f0f1 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] No waiting events found dispatching network-vif-plugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:58:05 user nova-compute[75813]: WARNING nova.compute.manager [req-b91d631e-52c1-464d-b01b-2ff6d954e190 req-50b65311-b18c-42c2-9aeb-cd0d30b0f0f1 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Received unexpected event network-vif-plugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 for instance with vm_state building and task_state spawning.
Nov 15 12:58:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:05 user nova-compute[75813]: INFO nova.compute.manager [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Took 6.18 seconds to build instance.
Nov 15 12:58:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-01792c99-6329-4c34-957f-2e3b3837ef7f tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.273s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:24 user nova-compute[75813]: INFO nova.compute.manager [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Terminating instance
Nov 15 12:58:24 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:58:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-5516d740-c328-482d-a59f-0d64cc8598a7 req-4f508b1a-022e-46a7-8ee4-7bb170517dec service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Received event network-vif-unplugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5516d740-c328-482d-a59f-0d64cc8598a7 req-4f508b1a-022e-46a7-8ee4-7bb170517dec service nova] Acquiring lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5516d740-c328-482d-a59f-0d64cc8598a7 req-4f508b1a-022e-46a7-8ee4-7bb170517dec service nova] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5516d740-c328-482d-a59f-0d64cc8598a7 req-4f508b1a-022e-46a7-8ee4-7bb170517dec service nova] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-5516d740-c328-482d-a59f-0d64cc8598a7 req-4f508b1a-022e-46a7-8ee4-7bb170517dec service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] No waiting events found dispatching network-vif-unplugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-5516d740-c328-482d-a59f-0d64cc8598a7 req-4f508b1a-022e-46a7-8ee4-7bb170517dec service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Received event network-vif-unplugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:58:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Instance destroyed successfully.
Nov 15 12:58:25 user nova-compute[75813]: DEBUG nova.objects.instance [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lazy-loading 'resources' on Instance uuid 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-519097021',display_name='tempest-VolumesAdminNegativeTest-server-519097021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-519097021',id=16,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4vHohf8iUtJwYF7jFsu982PRIqgU03JJiPRbyn6FK6+1gwivkR0eL1NHE7Y+DsQAwvVMm8dpEeBEJ9XTww235hwvH5AkWLLGMud5OnQjVvKAQ0eV9vZ2eko52NGo8roA==',key_name='tempest-keypair-1492071841',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='221ec165127e467a9131e2ff691429b1',ramdisk_id='',reservation_id='r-j4t3y6p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1498772195',owner_user_name='tempest-VolumesAdminNegativeTest-1498772195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fa6040843394b2fa38e29ff70e9d3ed',uuid=2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converting VIF {"id": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "address": "fa:16:3e:bc:9b:92", "network": {"id": "76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-592423879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221ec165127e467a9131e2ff691429b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1dbfc6-c7", "ovs_interfaceid": "6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:9b:92,bridge_name='br-int',has_traffic_filtering=True,id=6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1dbfc6-c7') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG os_vif [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:9b:92,bridge_name='br-int',has_traffic_filtering=True,id=6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1dbfc6-c7') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f1dbfc6-c7, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17259576-f54d-4bee-8b5f-5f6e5f4bfbdd) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:25 user nova-compute[75813]: INFO os_vif [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:9b:92,bridge_name='br-int',has_traffic_filtering=True,id=6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69,network=Network(76ed00b3-016b-4ebd-9bf1-82ca4c1f4ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1dbfc6-c7')
Nov 15 12:58:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Deleting instance files /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa_del
Nov 15 12:58:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Deletion of /opt/stack/data/nova/instances/2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa_del complete
Nov 15 12:58:25 user nova-compute[75813]: INFO nova.compute.manager [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 12:58:25 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:58:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:26 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:58:26 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Took 0.67 seconds to deallocate network for instance.
Nov 15 12:58:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-3ff2d3b3-d8e8-4de8-832d-0219ba9aa7b6 req-39c755b6-7a88-41a5-9db8-9c8b23fe6cde service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Received event network-vif-deleted-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:26 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:58:26 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:58:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:26 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Deleted allocations for instance 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa
Nov 15 12:58:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a4b1600-55d2-47fe-9cc0-ffb391c6bc90 tempest-VolumesAdminNegativeTest-1498772195 tempest-VolumesAdminNegativeTest-1498772195-project-member] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.955s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-7e661e73-3eda-4f18-8296-d536e2d00cf7 req-3e6c8d50-dc08-4825-847c-cb59267784de service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Received event network-vif-plugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e661e73-3eda-4f18-8296-d536e2d00cf7 req-3e6c8d50-dc08-4825-847c-cb59267784de service nova] Acquiring lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e661e73-3eda-4f18-8296-d536e2d00cf7 req-3e6c8d50-dc08-4825-847c-cb59267784de service nova] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7e661e73-3eda-4f18-8296-d536e2d00cf7 req-3e6c8d50-dc08-4825-847c-cb59267784de service nova] Lock "2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-7e661e73-3eda-4f18-8296-d536e2d00cf7 req-3e6c8d50-dc08-4825-847c-cb59267784de service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] No waiting events found dispatching network-vif-plugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:58:27 user nova-compute[75813]: WARNING nova.compute.manager [req-7e661e73-3eda-4f18-8296-d536e2d00cf7 req-3e6c8d50-dc08-4825-847c-cb59267784de service nova] [instance: 2f1caf6f-555f-4db8-8c9e-ee0a7a3a70fa] Received unexpected event network-vif-plugged-6f1dbfc6-c7c9-4ff1-98de-ee934b7afa69 for instance with vm_state deleted and task_state None.
Nov 15 12:58:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 12:58:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] There are 0 instances to clean {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 12:58:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:41 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-fd2dae3c-2247-435b-b647-3a65aafa0b82 req-ace5aa0f-92ee-4568-b2f1-f523a21d022d service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-changed-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-fd2dae3c-2247-435b-b647-3a65aafa0b82 req-ace5aa0f-92ee-4568-b2f1-f523a21d022d service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Refreshing instance network info cache due to event network-changed-3319e5d9-873b-44f6-bdd3-613b8a0a111f. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:58:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fd2dae3c-2247-435b-b647-3a65aafa0b82 req-ace5aa0f-92ee-4568-b2f1-f523a21d022d service nova] Acquiring lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:58:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fd2dae3c-2247-435b-b647-3a65aafa0b82 req-ace5aa0f-92ee-4568-b2f1-f523a21d022d service nova] Acquired lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:58:42 user nova-compute[75813]: DEBUG nova.network.neutron [req-fd2dae3c-2247-435b-b647-3a65aafa0b82 req-ace5aa0f-92ee-4568-b2f1-f523a21d022d service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Refreshing network info cache for port 3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-fd2dae3c-2247-435b-b647-3a65aafa0b82 req-ace5aa0f-92ee-4568-b2f1-f523a21d022d service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updated VIF entry in instance network info cache for port 3319e5d9-873b-44f6-bdd3-613b8a0a111f. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-fd2dae3c-2247-435b-b647-3a65aafa0b82 req-ace5aa0f-92ee-4568-b2f1-f523a21d022d service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating instance_info_cache with network_info: [{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fd2dae3c-2247-435b-b647-3a65aafa0b82 req-ace5aa0f-92ee-4568-b2f1-f523a21d022d service nova] Releasing lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75813) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:43 user nova-compute[75813]: INFO nova.compute.manager [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Shelve offloading
Nov 15 12:58:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:43 user nova-compute[75813]: INFO nova.compute.manager [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Terminating instance
Nov 15 12:58:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-26be4b54-3a02-41d6-b28a-e442ddcf4756 req-925ab81f-d3ef-4528-80b1-64f8b6f7e554 service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Received event network-vif-unplugged-56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-26be4b54-3a02-41d6-b28a-e442ddcf4756 req-925ab81f-d3ef-4528-80b1-64f8b6f7e554 service nova] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-26be4b54-3a02-41d6-b28a-e442ddcf4756 req-925ab81f-d3ef-4528-80b1-64f8b6f7e554 service nova] Lock "45154992-3213-43fa-89dc-d433f57ae978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-26be4b54-3a02-41d6-b28a-e442ddcf4756 req-925ab81f-d3ef-4528-80b1-64f8b6f7e554 service nova] Lock "45154992-3213-43fa-89dc-d433f57ae978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-26be4b54-3a02-41d6-b28a-e442ddcf4756 req-925ab81f-d3ef-4528-80b1-64f8b6f7e554 service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] No waiting events found dispatching network-vif-unplugged-56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-26be4b54-3a02-41d6-b28a-e442ddcf4756 req-925ab81f-d3ef-4528-80b1-64f8b6f7e554 service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Received event network-vif-unplugged-56dea8af-36d1-4ec2-be04-65a386672144 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 12:58:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Instance destroyed successfully.
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquired lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:58:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Instance destroyed successfully.
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lazy-loading 'resources' on Instance uuid 45154992-3213-43fa-89dc-d433f57ae978 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1729100775',display_name='tempest-SnapshotDataIntegrityTests-server-1729100775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1729100775',id=14,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQpVW7V8D1oVJDvZhE5Sa0vrL/1BGVJ6plPh2XV9hLcruHRkjFO7AXATQprlS2lBxLqgnM5WIgdj25aU8UCesWpDei9kHOkRJtnIzUA9cko+BFcTsU7xIMlhTh5WjqQiw==',key_name='tempest-keypair-1558375347',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:52:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a055627447c452fb366996320d60200',ramdisk_id='',reservation_id='r-9ed7vtiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-169717009',owner_user_name='tempest-SnapshotDataIntegrityTests-169717009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:52:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bf41fe4e06e4a0490cc6f9c20016d56',uuid=45154992-3213-43fa-89dc-d433f57ae978,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Converting VIF {"id": "56dea8af-36d1-4ec2-be04-65a386672144", "address": "fa:16:3e:a5:07:30", "network": {"id": "e41d07f1-168e-4349-9ecb-e02dca523951", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1164155589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a055627447c452fb366996320d60200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56dea8af-36", "ovs_interfaceid": "56dea8af-36d1-4ec2-be04-65a386672144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:07:30,bridge_name='br-int',has_traffic_filtering=True,id=56dea8af-36d1-4ec2-be04-65a386672144,network=Network(e41d07f1-168e-4349-9ecb-e02dca523951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56dea8af-36') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG os_vif [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:07:30,bridge_name='br-int',has_traffic_filtering=True,id=56dea8af-36d1-4ec2-be04-65a386672144,network=Network(e41d07f1-168e-4349-9ecb-e02dca523951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56dea8af-36') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56dea8af-36, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e98ac6d8-1a01-4e9c-b234-f2a0e86b2af9) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating instance_info_cache with network_info: [{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:44 user nova-compute[75813]: INFO os_vif [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:07:30,bridge_name='br-int',has_traffic_filtering=True,id=56dea8af-36d1-4ec2-be04-65a386672144,network=Network(e41d07f1-168e-4349-9ecb-e02dca523951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56dea8af-36')
Nov 15 12:58:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Deleting instance files /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978_del
Nov 15 12:58:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Deletion of /opt/stack/data/nova/instances/45154992-3213-43fa-89dc-d433f57ae978_del complete
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Releasing lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:58:44 user nova-compute[75813]: INFO nova.compute.manager [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 45154992-3213-43fa-89dc-d433f57ae978] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-vif-unplugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] No waiting events found dispatching network-vif-unplugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:58:44 user nova-compute[75813]: WARNING nova.compute.manager [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received unexpected event network-vif-unplugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f for instance with vm_state active and task_state shelving.
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] No waiting events found dispatching network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:58:44 user nova-compute[75813]: WARNING nova.compute.manager [req-a9be69a6-7d38-4a8a-a1f4-501927816456 req-4790cc76-1b81-40cd-be9f-a75694063034 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received unexpected event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f for instance with vm_state active and task_state shelving.
Nov 15 12:58:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating instance_info_cache with network_info: [{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:58:45 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Instance destroyed successfully.
Nov 15 12:58:45 user nova-compute[75813]: DEBUG nova.objects.instance [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lazy-loading 'resources' on Instance uuid be6a3a9f-c85c-4de8-b035-a4bead582c96 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1098721025',display_name='tempest-TestShelveInstance-server-1098721025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1098721025',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7N7MsxwT9JHHOFY9/PU8NI9pb7YXiy99jSoN272W+h+mOZ1+NJCSLRF4zDMoW1GoNvbRiXMBTud9XsJi3Zb6Vv5F32/zy56U70aKYebYlSDUaUmernScIGry8ivWyy6g==',key_name='tempest-TestShelveInstance-175836121',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f529adeb6b4124af5c49898ea718e1',ramdisk_id='',reservation_id='r-5dos5dei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-758391741',owner_user_name='tempest-TestShelveInstance-758391741-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:57:01Z,user_data=None,user_id='364157f6888d42c88318ab5f31b8132d',uuid=be6a3a9f-c85c-4de8-b035-a4bead582c96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converting VIF {"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_vif [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3319e5d9-87, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1b91ee7-4fc6-4d5e-8a86-df984dbb683a) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:58:45 user nova-compute[75813]: INFO os_vif [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87')
Nov 15 12:58:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZVKXryl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:58:45 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a688ddab-302c-43f9-81ba-7fb655e5c9ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 12:58:45 user nova-compute[75813]: No targets found.
Nov 15 12:58:45 user nova-compute[75813]: iSNS:
Nov 15 12:58:45 user nova-compute[75813]: No targets found.
Nov 15 12:58:45 user nova-compute[75813]: STATIC:
Nov 15 12:58:45 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d
Nov 15 12:58:45 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 12:58:45 user nova-compute[75813]:                 Iface Name: default
Nov 15 12:58:45 user nova-compute[75813]: FIRMWARE:
Nov 15 12:58:45 user nova-compute[75813]: No targets found.
Nov 15 12:58:45 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 12:58:45 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 12:58:45 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:45 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Took 1.00 seconds to deallocate network for instance.
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69ceff5-0d9d-4291-88d5-c178676746a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd685a1a-a6b9-4e52-89db-d133d33846c3]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 12:58:45 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 12:58:45 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55548ddf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b0192f-7ddf-47ab-bae1-dccf3d0ab95b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71c6a85-f32c-4623-8b4e-8ed8b53b361f]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[976d67f1-cfdb-423e-89ab-191a491feb1d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4049fac3-6cb1-498a-8681-b11472c76c8b]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d044fe9-39b6-4953-95c7-d62d27a35354]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b600717-65b8-4843-a257-fc9c8648e74f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260]
Nov 15 12:58:45 user nova-compute[75813]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260] successful.
Nov 15 12:58:45 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb7527d-5ef3-4c5a-9ca9-1599980f7345]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] <== disconnect_volume: return (289ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 12:58:45 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Deleting instance files /opt/stack/data/nova/instances/be6a3a9f-c85c-4de8-b035-a4bead582c96_del
Nov 15 12:58:45 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Deletion of /opt/stack/data/nova/instances/be6a3a9f-c85c-4de8-b035-a4bead582c96_del complete
Nov 15 12:58:45 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:58:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:45 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Deleted allocations for instance 45154992-3213-43fa-89dc-d433f57ae978
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-0ae05c57-fade-4e33-b733-aead87d0e21d req-cbef23b8-641d-45ff-8873-700c2176d20b service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Received event network-vif-plugged-56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0ae05c57-fade-4e33-b733-aead87d0e21d req-cbef23b8-641d-45ff-8873-700c2176d20b service nova] Acquiring lock "45154992-3213-43fa-89dc-d433f57ae978-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0ae05c57-fade-4e33-b733-aead87d0e21d req-cbef23b8-641d-45ff-8873-700c2176d20b service nova] Lock "45154992-3213-43fa-89dc-d433f57ae978-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0ae05c57-fade-4e33-b733-aead87d0e21d req-cbef23b8-641d-45ff-8873-700c2176d20b service nova] Lock "45154992-3213-43fa-89dc-d433f57ae978-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-0ae05c57-fade-4e33-b733-aead87d0e21d req-cbef23b8-641d-45ff-8873-700c2176d20b service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] No waiting events found dispatching network-vif-plugged-56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:58:46 user nova-compute[75813]: WARNING nova.compute.manager [req-0ae05c57-fade-4e33-b733-aead87d0e21d req-cbef23b8-641d-45ff-8873-700c2176d20b service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Received unexpected event network-vif-plugged-56dea8af-36d1-4ec2-be04-65a386672144 for instance with vm_state deleted and task_state None.
Nov 15 12:58:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c712af60-aebd-4bf3-a6ed-1f707eda3045 tempest-SnapshotDataIntegrityTests-169717009 tempest-SnapshotDataIntegrityTests-169717009-project-member] Lock "45154992-3213-43fa-89dc-d433f57ae978" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.445s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:46 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Deleted allocations for instance be6a3a9f-c85c-4de8-b035-a4bead582c96
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-75838f34-bbff-4c27-a532-fa2be159be1c req-e8365225-5bac-4f21-bb01-90760ba94a4b service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-changed-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-75838f34-bbff-4c27-a532-fa2be159be1c req-e8365225-5bac-4f21-bb01-90760ba94a4b service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Refreshing instance network info cache due to event network-changed-3319e5d9-873b-44f6-bdd3-613b8a0a111f. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-75838f34-bbff-4c27-a532-fa2be159be1c req-e8365225-5bac-4f21-bb01-90760ba94a4b service nova] Acquiring lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-75838f34-bbff-4c27-a532-fa2be159be1c req-e8365225-5bac-4f21-bb01-90760ba94a4b service nova] Acquired lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.network.neutron [req-75838f34-bbff-4c27-a532-fa2be159be1c req-e8365225-5bac-4f21-bb01-90760ba94a4b service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Refreshing network info cache for port 3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.objects.instance [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lazy-loading 'numa_topology' on Instance uuid be6a3a9f-c85c-4de8-b035-a4bead582c96 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.objects.base [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Object Instance<be6a3a9f-c85c-4de8-b035-a4bead582c96> lazy-loaded attributes: resources,numa_topology {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Refreshing inventories for resource provider 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Updating ProviderTree inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Refreshing aggregate associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, aggregates: None {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 12:58:46 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Refreshing trait associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, traits: HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 12:58:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:47 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:58:47 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:58:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e8fa754-5959-4509-81b4-83d329c503d5 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.992s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-75838f34-bbff-4c27-a532-fa2be159be1c req-e8365225-5bac-4f21-bb01-90760ba94a4b service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updated VIF entry in instance network info cache for port 3319e5d9-873b-44f6-bdd3-613b8a0a111f. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:58:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-75838f34-bbff-4c27-a532-fa2be159be1c req-e8365225-5bac-4f21-bb01-90760ba94a4b service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating instance_info_cache with network_info: [{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": null, "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3319e5d9-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:58:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-75838f34-bbff-4c27-a532-fa2be159be1c req-e8365225-5bac-4f21-bb01-90760ba94a4b service nova] Releasing lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:58:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-75838f34-bbff-4c27-a532-fa2be159be1c req-e8365225-5bac-4f21-bb01-90760ba94a4b service nova] [instance: 45154992-3213-43fa-89dc-d433f57ae978] Received event network-vif-deleted-56dea8af-36d1-4ec2-be04-65a386672144 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:48 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:51 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:58:51 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:58:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8051MB free_disk=25.364025115966797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 933c225a-9ff5-406b-9600-6a90e738810c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 0433b01f-5533-4902-bba4-41d47a3d394d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:58:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-a327057c-1ff9-434c-a9b0-1079245cf075 req-9f861dab-52f7-4181-8f8f-3f071eb854c4 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-changed-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:58:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-a327057c-1ff9-434c-a9b0-1079245cf075 req-9f861dab-52f7-4181-8f8f-3f071eb854c4 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Refreshing instance network info cache due to event network-changed-8472db86-c1ef-4c6a-a878-5951fa94e2e1. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:58:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a327057c-1ff9-434c-a9b0-1079245cf075 req-9f861dab-52f7-4181-8f8f-3f071eb854c4 service nova] Acquiring lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:58:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a327057c-1ff9-434c-a9b0-1079245cf075 req-9f861dab-52f7-4181-8f8f-3f071eb854c4 service nova] Acquired lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:58:52 user nova-compute[75813]: DEBUG nova.network.neutron [req-a327057c-1ff9-434c-a9b0-1079245cf075 req-9f861dab-52f7-4181-8f8f-3f071eb854c4 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Refreshing network info cache for port 8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:58:52 user nova-compute[75813]: DEBUG nova.network.neutron [req-a327057c-1ff9-434c-a9b0-1079245cf075 req-9f861dab-52f7-4181-8f8f-3f071eb854c4 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updated VIF entry in instance network info cache for port 8472db86-c1ef-4c6a-a878-5951fa94e2e1. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:58:52 user nova-compute[75813]: DEBUG nova.network.neutron [req-a327057c-1ff9-434c-a9b0-1079245cf075 req-9f861dab-52f7-4181-8f8f-3f071eb854c4 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updating instance_info_cache with network_info: [{"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:58:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a327057c-1ff9-434c-a9b0-1079245cf075 req-9f861dab-52f7-4181-8f8f-3f071eb854c4 service nova] Releasing lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG nova.objects.instance [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:58:54 user nova-compute[75813]: INFO nova.compute.manager [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Attaching volume daa28342-d5e4-49c5-9366-b3debd9a522a to /dev/vdb
Nov 15 12:58:54 user nova-compute[75813]: DEBUG os_brick.utils [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed6eb68-817b-4a91-95a5-9c4fdaaa270a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bda109-15be-4168-9977-74fdfc9b275e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[990319ba-7293-44b5-a08b-81649836202e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c7cf24-1075-44f9-92a6-2b9240401740]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:58:54 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:58:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63c27b1-7c2b-4156-a2df-589f673091bd]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG os_brick.utils [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:58:54 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updating existing volume attachment record: aa7d59f9-bce2-470b-bcc2-6c1e0761208e {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:58:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzSdGvTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:58:59 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:58:59 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:58:59 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9418fb64-18fe-4659-ba63-746091e3fe70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:58:59 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eddd9af-8586-4edf-ade0-25071ff365d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a] added
Nov 15 12:58:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2440f69-45b4-4996-9685-55aa87106747]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7861cab2-3c5a-4d0f-9b77-afd12eaf481f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzSdGvTm {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzSdGvTm" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5395fc9-d23a-4d4e-99cb-865e96e76ab9]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DzSdGvTm'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e2048f-973b-4ec0-8377-54b18007b77d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[375b682b-8885-4c74-9fdf-ad89f2920812]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:58:59 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 12:58:59 user nova-compute[75813]:  {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:58:59 user nova-compute[75813]: WARNING os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 12:58:59 user nova-compute[75813]: 
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70e3d53-61bc-436c-9b27-c27ae07be835]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260]
Nov 15 12:58:59 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260] successful.
Nov 15 12:58:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3476faea-9311-4034-a778-bac693ecd07e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce16e94-5456-4946-bd16-a9188acdecff]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 12:58:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 12:58:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[680114e6-9a8d-4b62-b85f-88f1e31f3109]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:58:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzSdGvTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23163636330356636', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163636330356636', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG nova.objects.instance [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:59:00 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:59:00 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 12:59:00 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:59:00 user nova-compute[75813]:   <serial>daa28342-d5e4-49c5-9366-b3debd9a522a</serial>
Nov 15 12:59:00 user nova-compute[75813]: </disk>
Nov 15 12:59:00 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:59:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No VIF found with MAC fa:16:3e:2f:03:54, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:59:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1cebcea6-1bfc-4203-b1aa-307208042a58 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.474s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bb668914-5ed6-42ea-945b-4c42a89585c9 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bb668914-5ed6-42ea-945b-4c42a89585c9 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bb668914-5ed6-42ea-945b-4c42a89585c9 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bb668914-5ed6-42ea-945b-4c42a89585c9 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75813) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG nova.objects.instance [None req-bb668914-5ed6-42ea-945b-4c42a89585c9 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-efc3d521-0b43-400a-9ece-d1d628427971 req-e580127f-57a7-4666-b4e9-240e07d8e87d service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-unplugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-efc3d521-0b43-400a-9ece-d1d628427971 req-e580127f-57a7-4666-b4e9-240e07d8e87d service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-efc3d521-0b43-400a-9ece-d1d628427971 req-e580127f-57a7-4666-b4e9-240e07d8e87d service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-efc3d521-0b43-400a-9ece-d1d628427971 req-e580127f-57a7-4666-b4e9-240e07d8e87d service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-efc3d521-0b43-400a-9ece-d1d628427971 req-e580127f-57a7-4666-b4e9-240e07d8e87d service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-unplugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:59:02 user nova-compute[75813]: WARNING nova.compute.manager [req-efc3d521-0b43-400a-9ece-d1d628427971 req-e580127f-57a7-4666-b4e9-240e07d8e87d service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received unexpected event network-vif-unplugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with vm_state active and task_state powering-off.
Nov 15 12:59:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:03 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance destroyed successfully.
Nov 15 12:59:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bb668914-5ed6-42ea-945b-4c42a89585c9 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:59:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bb668914-5ed6-42ea-945b-4c42a89585c9 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.882s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-853da416-e970-43bb-a539-b8d3bc65ad11 req-cfc7d6f5-a658-4d73-a89b-f4ac7caac546 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:59:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-853da416-e970-43bb-a539-b8d3bc65ad11 req-cfc7d6f5-a658-4d73-a89b-f4ac7caac546 service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-853da416-e970-43bb-a539-b8d3bc65ad11 req-cfc7d6f5-a658-4d73-a89b-f4ac7caac546 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-853da416-e970-43bb-a539-b8d3bc65ad11 req-cfc7d6f5-a658-4d73-a89b-f4ac7caac546 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-853da416-e970-43bb-a539-b8d3bc65ad11 req-cfc7d6f5-a658-4d73-a89b-f4ac7caac546 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:59:04 user nova-compute[75813]: WARNING nova.compute.manager [req-853da416-e970-43bb-a539-b8d3bc65ad11 req-cfc7d6f5-a658-4d73-a89b-f4ac7caac546 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received unexpected event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with vm_state stopped and task_state None.
Nov 15 12:59:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-5ef13864-40f8-4a29-b4a7-9200df1918b4 req-33b14cdb-9e72-4285-9fea-29ee44c4a0f9 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-changed-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-5ef13864-40f8-4a29-b4a7-9200df1918b4 req-33b14cdb-9e72-4285-9fea-29ee44c4a0f9 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Refreshing instance network info cache due to event network-changed-d38d4cbb-3312-4630-a9e2-27a4dadec958. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5ef13864-40f8-4a29-b4a7-9200df1918b4 req-33b14cdb-9e72-4285-9fea-29ee44c4a0f9 service nova] Acquiring lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5ef13864-40f8-4a29-b4a7-9200df1918b4 req-33b14cdb-9e72-4285-9fea-29ee44c4a0f9 service nova] Acquired lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG nova.network.neutron [req-5ef13864-40f8-4a29-b4a7-9200df1918b4 req-33b14cdb-9e72-4285-9fea-29ee44c4a0f9 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Refreshing network info cache for port d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG nova.network.neutron [req-5ef13864-40f8-4a29-b4a7-9200df1918b4 req-33b14cdb-9e72-4285-9fea-29ee44c4a0f9 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updated VIF entry in instance network info cache for port d38d4cbb-3312-4630-a9e2-27a4dadec958. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG nova.network.neutron [req-5ef13864-40f8-4a29-b4a7-9200df1918b4 req-33b14cdb-9e72-4285-9fea-29ee44c4a0f9 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updating instance_info_cache with network_info: [{"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:59:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5ef13864-40f8-4a29-b4a7-9200df1918b4 req-33b14cdb-9e72-4285-9fea-29ee44c4a0f9 service nova] Releasing lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:59:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:12 user nova-compute[75813]: INFO nova.compute.manager [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Shelving
Nov 15 12:59:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-8671d97b-f999-4ae5-b821-c28b5dbe81a1 req-3cae4221-7d1f-41c3-b7fd-122be55bbb9c service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-vif-unplugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:59:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8671d97b-f999-4ae5-b821-c28b5dbe81a1 req-3cae4221-7d1f-41c3-b7fd-122be55bbb9c service nova] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8671d97b-f999-4ae5-b821-c28b5dbe81a1 req-3cae4221-7d1f-41c3-b7fd-122be55bbb9c service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8671d97b-f999-4ae5-b821-c28b5dbe81a1 req-3cae4221-7d1f-41c3-b7fd-122be55bbb9c service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-8671d97b-f999-4ae5-b821-c28b5dbe81a1 req-3cae4221-7d1f-41c3-b7fd-122be55bbb9c service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] No waiting events found dispatching network-vif-unplugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:59:13 user nova-compute[75813]: WARNING nova.compute.manager [req-8671d97b-f999-4ae5-b821-c28b5dbe81a1 req-3cae4221-7d1f-41c3-b7fd-122be55bbb9c service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received unexpected event network-vif-unplugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 for instance with vm_state active and task_state shelving.
Nov 15 12:59:13 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Instance destroyed successfully.
Nov 15 12:59:13 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Beginning cold snapshot process
Nov 15 12:59:13 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 12:59:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk /opt/stack/data/nova/instances/snapshots/tmpnldo4226/d1fe3f73db934fe99c0cce5989310be0 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk /opt/stack/data/nova/instances/snapshots/tmpnldo4226/d1fe3f73db934fe99c0cce5989310be0" returned: 0 in 0.946s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:14 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Snapshot extracted, beginning image upload
Nov 15 12:59:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-1174cc1c-e97c-4578-9f49-a84322b84c9c req-6c08586e-04a8-4562-824d-83f3d63c5a32 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:59:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1174cc1c-e97c-4578-9f49-a84322b84c9c req-6c08586e-04a8-4562-824d-83f3d63c5a32 service nova] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1174cc1c-e97c-4578-9f49-a84322b84c9c req-6c08586e-04a8-4562-824d-83f3d63c5a32 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1174cc1c-e97c-4578-9f49-a84322b84c9c req-6c08586e-04a8-4562-824d-83f3d63c5a32 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-1174cc1c-e97c-4578-9f49-a84322b84c9c req-6c08586e-04a8-4562-824d-83f3d63c5a32 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] No waiting events found dispatching network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:59:15 user nova-compute[75813]: WARNING nova.compute.manager [req-1174cc1c-e97c-4578-9f49-a84322b84c9c req-6c08586e-04a8-4562-824d-83f3d63c5a32 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received unexpected event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 12:59:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:17 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Snapshot image upload complete
Nov 15 12:59:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:59:17 user nova-compute[75813]: INFO nova.compute.manager [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Shelve offloading
Nov 15 12:59:17 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Instance destroyed successfully.
Nov 15 12:59:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:59:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:59:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquired lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:59:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updating instance_info_cache with network_info: [{"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Releasing lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Instance destroyed successfully.
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'resources' on Instance uuid 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-850952693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-850952693',id=22,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqVs2iLbmwX7/vowP0VC4cDfMVoE7o+iBjs+PlvP8I1SdBilZWyP/O6U7deeJL9IG22ogmYjkpNi1UI64FWTxrk4u73gBCVAkow6+DTajJvUW/fQXviHhni4tmqSXqWoA==',key_name='tempest-keypair-1330676257',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-kdv40ajl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member',shelved_at='2023-11-15T12:59:17.505422',shelved_host='user',shelved_image_id='4d57ae0b-9277-4548-9020-0d37be925cd6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:59:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=933c225a-9ff5-406b-9600-6a90e738810c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG os_vif [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd38d4cbb-33, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-685e2439-4172-43d4-bc6a-32079c231818 req-06446ae6-7280-403e-ab8d-0822154ad052 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-changed-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-685e2439-4172-43d4-bc6a-32079c231818 req-06446ae6-7280-403e-ab8d-0822154ad052 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Refreshing instance network info cache due to event network-changed-d38d4cbb-3312-4630-a9e2-27a4dadec958. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-685e2439-4172-43d4-bc6a-32079c231818 req-06446ae6-7280-403e-ab8d-0822154ad052 service nova] Acquiring lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-685e2439-4172-43d4-bc6a-32079c231818 req-06446ae6-7280-403e-ab8d-0822154ad052 service nova] Acquired lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.network.neutron [req-685e2439-4172-43d4-bc6a-32079c231818 req-06446ae6-7280-403e-ab8d-0822154ad052 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Refreshing network info cache for port d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f434776-3204-4949-98bd-56e501c9e24a) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:18 user nova-compute[75813]: INFO os_vif [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33')
Nov 15 12:59:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Deleting instance files /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c_del
Nov 15 12:59:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Deletion of /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c_del complete
Nov 15 12:59:18 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Deleted allocations for instance 933c225a-9ff5-406b-9600-6a90e738810c
Nov 15 12:59:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'numa_topology' on Instance uuid 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.objects.base [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Object Instance<933c225a-9ff5-406b-9600-6a90e738810c> lazy-loaded attributes: resources,numa_topology {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:59:18 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:59:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:19 user nova-compute[75813]: DEBUG nova.network.neutron [req-685e2439-4172-43d4-bc6a-32079c231818 req-06446ae6-7280-403e-ab8d-0822154ad052 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updated VIF entry in instance network info cache for port d38d4cbb-3312-4630-a9e2-27a4dadec958. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:59:19 user nova-compute[75813]: DEBUG nova.network.neutron [req-685e2439-4172-43d4-bc6a-32079c231818 req-06446ae6-7280-403e-ab8d-0822154ad052 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updating instance_info_cache with network_info: [{"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:59:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-685e2439-4172-43d4-bc6a-32079c231818 req-06446ae6-7280-403e-ab8d-0822154ad052 service nova] Releasing lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:59:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9cc9b852-6c61-4bcd-acc2-5e881086a4f3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.209s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:59:19 user nova-compute[75813]: INFO nova.compute.manager [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] instance snapshotting
Nov 15 12:59:19 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Beginning live snapshot process
Nov 15 12:59:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json -f qcow2 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json -f qcow2 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json -f qcow2" returned: 0 in 0.167s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2cqfwsan/5f9baa08d08e4415a7fbbbe6c8e96a8b.delta 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2cqfwsan/5f9baa08d08e4415a7fbbbe6c8e96a8b.delta 1073741824" returned: 0 in 0.045s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 12:59:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:59:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 12:59:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 12:59:22 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 12:59:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2cqfwsan/5f9baa08d08e4415a7fbbbe6c8e96a8b.delta /opt/stack/data/nova/instances/snapshots/tmp2cqfwsan/5f9baa08d08e4415a7fbbbe6c8e96a8b {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2cqfwsan/5f9baa08d08e4415a7fbbbe6c8e96a8b.delta /opt/stack/data/nova/instances/snapshots/tmp2cqfwsan/5f9baa08d08e4415a7fbbbe6c8e96a8b" returned: 0 in 0.306s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:22 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Snapshot extracted, beginning image upload
Nov 15 12:59:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Snapshot image upload complete
Nov 15 12:59:25 user nova-compute[75813]: INFO nova.compute.manager [None req-edea35eb-6015-4357-a16c-a1b99f66fe4e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Took 5.26 seconds to snapshot the instance on the hypervisor.
Nov 15 12:59:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:32 user nova-compute[75813]: DEBUG nova.compute.manager [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 12:59:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:32 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 12:59:32 user nova-compute[75813]: INFO nova.compute.claims [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Claim successful on node user
Nov 15 12:59:32 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:59:32 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:59:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:32 user nova-compute[75813]: DEBUG nova.compute.manager [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG nova.network.neutron [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 12:59:33 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 12:59:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG nova.policy [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63700cf0bb0044a59c71f38fe702e812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64457e74254e47b6845be2aef4de8206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 12:59:33 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Creating image(s)
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "/opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "/opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk 1073741824" returned: 0 in 0.049s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG nova.network.neutron [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Successfully created port: 0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Cannot resize image /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Ensure instance console log exists: /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.network.neutron [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Successfully updated port: 0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquired lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.network.neutron [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-0a89cef0-065d-458f-bf7e-72273fdc914e req-068e89cd-7d19-48d1-9727-8dc7f1458ff1 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-changed-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-0a89cef0-065d-458f-bf7e-72273fdc914e req-068e89cd-7d19-48d1-9727-8dc7f1458ff1 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Refreshing instance network info cache due to event network-changed-0855cbc5-0088-42fb-be12-422784a52b93. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0a89cef0-065d-458f-bf7e-72273fdc914e req-068e89cd-7d19-48d1-9727-8dc7f1458ff1 service nova] Acquiring lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.network.neutron [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.network.neutron [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updating instance_info_cache with network_info: [{"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Releasing lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Instance network_info: |[{"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0a89cef0-065d-458f-bf7e-72273fdc914e req-068e89cd-7d19-48d1-9727-8dc7f1458ff1 service nova] Acquired lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.network.neutron [req-0a89cef0-065d-458f-bf7e-72273fdc914e req-068e89cd-7d19-48d1-9727-8dc7f1458ff1 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Refreshing network info cache for port 0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Start _get_guest_xml network_info=[{"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 12:59:34 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:59:34 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-769032625',display_name='tempest-ServerStableDeviceRescueTest-server-769032625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-769032625',id=26,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzzk9jkYa2qK3g2qHA80X2IIlCEvYNVQHBu3MXjtij+IveyI/kQM+mfPmI4bzYJMNgOrabk3d96/29iEiC5VLn8uVpUX8YHFyrCAmQw348M8B4eJlyJR5go7pI8xa1dXA==',key_name='tempest-keypair-1027890915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64457e74254e47b6845be2aef4de8206',ramdisk_id='',reservation_id='r-ae33rltr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-344856713',owner_user_name='tempest-ServerStableDeviceRescueTest-344856713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63700cf0bb0044a59c71f38fe702e812',uuid=9fed6377-0614-41ae-b421-75d74da5fa4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Converting VIF {"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:f9:c7,bridge_name='br-int',has_traffic_filtering=True,id=0855cbc5-0088-42fb-be12-422784a52b93,network=Network(87e7af6f-5cca-4d1f-8c4d-8763e71bfa17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0855cbc5-00') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.objects.instance [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 12:59:34 user nova-compute[75813]:   <uuid>9fed6377-0614-41ae-b421-75d74da5fa4f</uuid>
Nov 15 12:59:34 user nova-compute[75813]:   <name>instance-0000001a</name>
Nov 15 12:59:34 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 12:59:34 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 12:59:34 user nova-compute[75813]:   <metadata>
Nov 15 12:59:34 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 12:59:34 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 12:59:34 user nova-compute[75813]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-769032625</nova:name>
Nov 15 12:59:34 user nova-compute[75813]:       <nova:creationTime>2023-11-15 12:59:34</nova:creationTime>
Nov 15 12:59:34 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 12:59:34 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 12:59:34 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 12:59:34 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 12:59:34 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 12:59:34 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 12:59:34 user nova-compute[75813]:       </nova:flavor>
Nov 15 12:59:34 user nova-compute[75813]:       <nova:owner>
Nov 15 12:59:34 user nova-compute[75813]:         <nova:user uuid="63700cf0bb0044a59c71f38fe702e812">tempest-ServerStableDeviceRescueTest-344856713-project-member</nova:user>
Nov 15 12:59:34 user nova-compute[75813]:         <nova:project uuid="64457e74254e47b6845be2aef4de8206">tempest-ServerStableDeviceRescueTest-344856713</nova:project>
Nov 15 12:59:34 user nova-compute[75813]:       </nova:owner>
Nov 15 12:59:34 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 12:59:34 user nova-compute[75813]:       <nova:ports>
Nov 15 12:59:34 user nova-compute[75813]:         <nova:port uuid="0855cbc5-0088-42fb-be12-422784a52b93">
Nov 15 12:59:34 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 12:59:34 user nova-compute[75813]:         </nova:port>
Nov 15 12:59:34 user nova-compute[75813]:       </nova:ports>
Nov 15 12:59:34 user nova-compute[75813]:     </nova:instance>
Nov 15 12:59:34 user nova-compute[75813]:   </metadata>
Nov 15 12:59:34 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 12:59:34 user nova-compute[75813]:     <system>
Nov 15 12:59:34 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 12:59:34 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 12:59:34 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 12:59:34 user nova-compute[75813]:       <entry name="serial">9fed6377-0614-41ae-b421-75d74da5fa4f</entry>
Nov 15 12:59:34 user nova-compute[75813]:       <entry name="uuid">9fed6377-0614-41ae-b421-75d74da5fa4f</entry>
Nov 15 12:59:34 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 12:59:34 user nova-compute[75813]:     </system>
Nov 15 12:59:34 user nova-compute[75813]:   </sysinfo>
Nov 15 12:59:34 user nova-compute[75813]:   <os>
Nov 15 12:59:34 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 12:59:34 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 12:59:34 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 12:59:34 user nova-compute[75813]:   </os>
Nov 15 12:59:34 user nova-compute[75813]:   <features>
Nov 15 12:59:34 user nova-compute[75813]:     <acpi/>
Nov 15 12:59:34 user nova-compute[75813]:     <apic/>
Nov 15 12:59:34 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 12:59:34 user nova-compute[75813]:   </features>
Nov 15 12:59:34 user nova-compute[75813]:   <clock offset="utc">
Nov 15 12:59:34 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 12:59:34 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 12:59:34 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 12:59:34 user nova-compute[75813]:   </clock>
Nov 15 12:59:34 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 12:59:34 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 12:59:34 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 12:59:34 user nova-compute[75813]:   </cpu>
Nov 15 12:59:34 user nova-compute[75813]:   <devices>
Nov 15 12:59:34 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 12:59:34 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 12:59:34 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk"/>
Nov 15 12:59:34 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 12:59:34 user nova-compute[75813]:     </disk>
Nov 15 12:59:34 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 12:59:34 user nova-compute[75813]:       <mac address="fa:16:3e:51:f9:c7"/>
Nov 15 12:59:34 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:59:34 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 12:59:34 user nova-compute[75813]:       <target dev="tap0855cbc5-00"/>
Nov 15 12:59:34 user nova-compute[75813]:     </interface>
Nov 15 12:59:34 user nova-compute[75813]:     <serial type="pty">
Nov 15 12:59:34 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/console.log" append="off"/>
Nov 15 12:59:34 user nova-compute[75813]:     </serial>
Nov 15 12:59:34 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 12:59:34 user nova-compute[75813]:     <video>
Nov 15 12:59:34 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 12:59:34 user nova-compute[75813]:     </video>
Nov 15 12:59:34 user nova-compute[75813]:     <rng model="virtio">
Nov 15 12:59:34 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 12:59:34 user nova-compute[75813]:     </rng>
Nov 15 12:59:34 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 12:59:34 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 12:59:34 user nova-compute[75813]:       <stats period="10"/>
Nov 15 12:59:34 user nova-compute[75813]:     </memballoon>
Nov 15 12:59:34 user nova-compute[75813]:   </devices>
Nov 15 12:59:34 user nova-compute[75813]: </domain>
Nov 15 12:59:34 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-769032625',display_name='tempest-ServerStableDeviceRescueTest-server-769032625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-769032625',id=26,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzzk9jkYa2qK3g2qHA80X2IIlCEvYNVQHBu3MXjtij+IveyI/kQM+mfPmI4bzYJMNgOrabk3d96/29iEiC5VLn8uVpUX8YHFyrCAmQw348M8B4eJlyJR5go7pI8xa1dXA==',key_name='tempest-keypair-1027890915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64457e74254e47b6845be2aef4de8206',ramdisk_id='',reservation_id='r-ae33rltr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-344856713',owner_user_name='tempest-ServerStableDeviceRescueTest-344856713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63700cf0bb0044a59c71f38fe702e812',uuid=9fed6377-0614-41ae-b421-75d74da5fa4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Converting VIF {"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:f9:c7,bridge_name='br-int',has_traffic_filtering=True,id=0855cbc5-0088-42fb-be12-422784a52b93,network=Network(87e7af6f-5cca-4d1f-8c4d-8763e71bfa17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0855cbc5-00') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG os_vif [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:f9:c7,bridge_name='br-int',has_traffic_filtering=True,id=0855cbc5-0088-42fb-be12-422784a52b93,network=Network(87e7af6f-5cca-4d1f-8c4d-8763e71bfa17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0855cbc5-00') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7908e839-5a3e-54c8-b664-e126bb2a216a', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0855cbc5-00, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0855cbc5-00, col_values=(('qos', UUID('30d92025-5e51-4102-b798-765fe3c66d5d')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0855cbc5-00, col_values=(('external_ids', {'iface-id': '0855cbc5-0088-42fb-be12-422784a52b93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:f9:c7', 'vm-uuid': '9fed6377-0614-41ae-b421-75d74da5fa4f'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 12:59:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 12:59:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:35 user nova-compute[75813]: INFO os_vif [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:f9:c7,bridge_name='br-int',has_traffic_filtering=True,id=0855cbc5-0088-42fb-be12-422784a52b93,network=Network(87e7af6f-5cca-4d1f-8c4d-8763e71bfa17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0855cbc5-00')
Nov 15 12:59:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:59:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] No VIF found with MAC fa:16:3e:51:f9:c7, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:59:35 user nova-compute[75813]: DEBUG nova.network.neutron [req-0a89cef0-065d-458f-bf7e-72273fdc914e req-068e89cd-7d19-48d1-9727-8dc7f1458ff1 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updated VIF entry in instance network info cache for port 0855cbc5-0088-42fb-be12-422784a52b93. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:59:35 user nova-compute[75813]: DEBUG nova.network.neutron [req-0a89cef0-065d-458f-bf7e-72273fdc914e req-068e89cd-7d19-48d1-9727-8dc7f1458ff1 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updating instance_info_cache with network_info: [{"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:59:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0a89cef0-065d-458f-bf7e-72273fdc914e req-068e89cd-7d19-48d1-9727-8dc7f1458ff1 service nova] Releasing lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:59:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:36 user nova-compute[75813]: DEBUG nova.compute.manager [req-a5261fa9-01d6-4e23-bb17-b45c005283a9 req-816229a6-8fe8-406f-8b4e-6b0c12b4f000 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:59:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a5261fa9-01d6-4e23-bb17-b45c005283a9 req-816229a6-8fe8-406f-8b4e-6b0c12b4f000 service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a5261fa9-01d6-4e23-bb17-b45c005283a9 req-816229a6-8fe8-406f-8b4e-6b0c12b4f000 service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a5261fa9-01d6-4e23-bb17-b45c005283a9 req-816229a6-8fe8-406f-8b4e-6b0c12b4f000 service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:36 user nova-compute[75813]: DEBUG nova.compute.manager [req-a5261fa9-01d6-4e23-bb17-b45c005283a9 req-816229a6-8fe8-406f-8b4e-6b0c12b4f000 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:59:36 user nova-compute[75813]: WARNING nova.compute.manager [req-a5261fa9-01d6-4e23-bb17-b45c005283a9 req-816229a6-8fe8-406f-8b4e-6b0c12b4f000 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received unexpected event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with vm_state building and task_state spawning.
Nov 15 12:59:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 12:59:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Instance spawned successfully.
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 12:59:38 user nova-compute[75813]: INFO nova.compute.manager [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-4c7bd222-5a5c-4b1d-a31e-f9b108a10365 req-0a53b5d7-3c22-47d2-8ee6-ef5687d9ed5f service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4c7bd222-5a5c-4b1d-a31e-f9b108a10365 req-0a53b5d7-3c22-47d2-8ee6-ef5687d9ed5f service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4c7bd222-5a5c-4b1d-a31e-f9b108a10365 req-0a53b5d7-3c22-47d2-8ee6-ef5687d9ed5f service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4c7bd222-5a5c-4b1d-a31e-f9b108a10365 req-0a53b5d7-3c22-47d2-8ee6-ef5687d9ed5f service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-4c7bd222-5a5c-4b1d-a31e-f9b108a10365 req-0a53b5d7-3c22-47d2-8ee6-ef5687d9ed5f service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 12:59:38 user nova-compute[75813]: WARNING nova.compute.manager [req-4c7bd222-5a5c-4b1d-a31e-f9b108a10365 req-0a53b5d7-3c22-47d2-8ee6-ef5687d9ed5f service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received unexpected event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with vm_state building and task_state spawning.
Nov 15 12:59:38 user nova-compute[75813]: INFO nova.compute.manager [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Took 6.11 seconds to build instance.
Nov 15 12:59:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-539a52ef-391c-46fb-9e17-9fcad81b4eed tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.205s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-80380771-2b57-41b0-8b13-5c6efb508521 req-9bc27b53-b8a5-47a4-bcf7-e7fbaba53732 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received event network-changed-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:59:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-80380771-2b57-41b0-8b13-5c6efb508521 req-9bc27b53-b8a5-47a4-bcf7-e7fbaba53732 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Refreshing instance network info cache due to event network-changed-47f90629-6062-435c-82c7-44fb6630327c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:59:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-80380771-2b57-41b0-8b13-5c6efb508521 req-9bc27b53-b8a5-47a4-bcf7-e7fbaba53732 service nova] Acquiring lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:59:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-80380771-2b57-41b0-8b13-5c6efb508521 req-9bc27b53-b8a5-47a4-bcf7-e7fbaba53732 service nova] Acquired lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:59:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-80380771-2b57-41b0-8b13-5c6efb508521 req-9bc27b53-b8a5-47a4-bcf7-e7fbaba53732 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Refreshing network info cache for port 47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:59:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-80380771-2b57-41b0-8b13-5c6efb508521 req-9bc27b53-b8a5-47a4-bcf7-e7fbaba53732 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updated VIF entry in instance network info cache for port 47f90629-6062-435c-82c7-44fb6630327c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:59:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-80380771-2b57-41b0-8b13-5c6efb508521 req-9bc27b53-b8a5-47a4-bcf7-e7fbaba53732 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updating instance_info_cache with network_info: [{"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:59:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-80380771-2b57-41b0-8b13-5c6efb508521 req-9bc27b53-b8a5-47a4-bcf7-e7fbaba53732 service nova] Releasing lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:59:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:59:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:59:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 12:59:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:59:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:59:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 12:59:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updating instance_info_cache with network_info: [{"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:59:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:59:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 12:59:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:59:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:59:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:59:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:59:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 12:59:48 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-38499982-6cec-4518-9841-79ce53a15aa3 req-71f4f154-856c-4747-add3-a8fd5dc430ed service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Received event network-changed-9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-38499982-6cec-4518-9841-79ce53a15aa3 req-71f4f154-856c-4747-add3-a8fd5dc430ed service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Refreshing instance network info cache due to event network-changed-9ced7d59-eed0-45d0-bcc6-acd2a842c921. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38499982-6cec-4518-9841-79ce53a15aa3 req-71f4f154-856c-4747-add3-a8fd5dc430ed service nova] Acquiring lock "refresh_cache-0433b01f-5533-4902-bba4-41d47a3d394d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38499982-6cec-4518-9841-79ce53a15aa3 req-71f4f154-856c-4747-add3-a8fd5dc430ed service nova] Acquired lock "refresh_cache-0433b01f-5533-4902-bba4-41d47a3d394d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-38499982-6cec-4518-9841-79ce53a15aa3 req-71f4f154-856c-4747-add3-a8fd5dc430ed service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Refreshing network info cache for port 9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.network.neutron [req-38499982-6cec-4518-9841-79ce53a15aa3 req-71f4f154-856c-4747-add3-a8fd5dc430ed service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Updated VIF entry in instance network info cache for port 9ced7d59-eed0-45d0-bcc6-acd2a842c921. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.network.neutron [req-38499982-6cec-4518-9841-79ce53a15aa3 req-71f4f154-856c-4747-add3-a8fd5dc430ed service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Updating instance_info_cache with network_info: [{"id": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "address": "fa:16:3e:f2:6f:97", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ced7d59-ee", "ovs_interfaceid": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38499982-6cec-4518-9841-79ce53a15aa3 req-71f4f154-856c-4747-add3-a8fd5dc430ed service nova] Releasing lock "refresh_cache-0433b01f-5533-4902-bba4-41d47a3d394d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:51 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:59:51 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8490MB free_disk=25.289962768554688GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 0433b01f-5533-4902-bba4-41d47a3d394d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 9fed6377-0614-41ae-b421-75d74da5fa4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 12:59:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "0433b01f-5533-4902-bba4-41d47a3d394d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG nova.objects.instance [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'flavor' on Instance uuid 0433b01f-5533-4902-bba4-41d47a3d394d {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "0433b01f-5533-4902-bba4-41d47a3d394d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 12:59:52 user nova-compute[75813]: INFO nova.compute.manager [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Attaching volume 091dff73-3dc9-429a-a54a-e457fba2a71e to /dev/vdb
Nov 15 12:59:52 user nova-compute[75813]: DEBUG os_brick.utils [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0935d8cf-7bf4-4e80-92e8-65e67465f36d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7a69a7-545e-47b2-923c-3268fbe0ca88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c802e-9ba9-4dfc-bcbd-b4588ddbf249]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d1285f-912c-44a7-96b8-b75376d98745]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 12:59:52 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[46064c48-4bc7-497d-b936-3aad8aad6234]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG os_brick.utils [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Updating existing volume attachment record: badbb35f-368b-4023-9c7c-b56348429946 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 12:59:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 12:59:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZudCngyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 12:59:57 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:59:57 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 12:59:57 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[efca9dfc-e442-45e8-8db4-ab1059f5bf21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 12:59:57 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6478dbea-8bfd-49e1-a84b-442d134ed206]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e] added
Nov 15 12:59:57 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[612dd914-ae44-4fd2-8ade-763489b14c79]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3420ba-b228-4db6-bb83-2105c39a4221]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZudCngyF {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZudCngyF" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c6624f-efcf-4c8b-a59d-134e7dcbf5c1]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZudCngyF'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b3de1e-5e77-4349-8bf0-3ea21e98b917]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[473050c3-2612-44be-a1f9-36b57dcd98fb]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 12:59:57 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 12:59:57 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[750a24af-91b2-4229-bf63-0b5f2ccfbf35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e, portal: 172.16.0.220,3260]
Nov 15 12:59:57 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e, portal: 172.16.0.220,3260] successful.
Nov 15 12:59:57 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d84638-8bb8-4b78-bee4-a4f57fee2d90]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[736ba56b-6d11-4714-924f-12fb0018135a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 12:59:57 user nova-compute[75813]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e (non-flash)
Nov 15 12:59:57 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 12:59:57 user nova-compute[75813]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e (non-flash)
Nov 15 12:59:57 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa7261b-28b4-45f4-a53e-e7b573f2f427]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 12:59:57 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZudCngyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 12:59:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 12:59:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23962343062366135', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 12:59:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962343062366135', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 12:59:58 user nova-compute[75813]: DEBUG nova.objects.instance [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'flavor' on Instance uuid 0433b01f-5533-4902-bba4-41d47a3d394d {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 12:59:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 12:59:58 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 12:59:58 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 12:59:58 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 12:59:58 user nova-compute[75813]:   <serial>091dff73-3dc9-429a-a54a-e457fba2a71e</serial>
Nov 15 12:59:58 user nova-compute[75813]: </disk>
Nov 15 12:59:58 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 12:59:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:59:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 12:59:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] No VIF found with MAC fa:16:3e:f2:6f:97, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 12:59:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7700a96d-cfdf-479d-82ef-6807f82d6dbc tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.550s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "0433b01f-5533-4902-bba4-41d47a3d394d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:00 user nova-compute[75813]: INFO nova.compute.manager [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Detaching volume 091dff73-3dc9-429a-a54a-e457fba2a71e
Nov 15 13:00:00 user nova-compute[75813]: INFO nova.virt.block_device [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Attempting to driver detach volume 091dff73-3dc9-429a-a54a-e457fba2a71e from mountpoint /dev/vdb
Nov 15 13:00:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Attempting to detach device vdb from instance 0433b01f-5533-4902-bba4-41d47a3d394d from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:00:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:00:00 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:00:00 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:00:00 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:00:00 user nova-compute[75813]:   <serial>091dff73-3dc9-429a-a54a-e457fba2a71e</serial>
Nov 15 13:00:00 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:00:00 user nova-compute[75813]: </disk>
Nov 15 13:00:00 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:00:00 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully detached device vdb from instance 0433b01f-5533-4902-bba4-41d47a3d394d from the persistent domain config.
Nov 15 13:00:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0433b01f-5533-4902-bba4-41d47a3d394d from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:00:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:00:00 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:00:00 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:00:00 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:00:00 user nova-compute[75813]:   <serial>091dff73-3dc9-429a-a54a-e457fba2a71e</serial>
Nov 15 13:00:00 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:00:00 user nova-compute[75813]: </disk>
Nov 15 13:00:00 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:00:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0433b01f-5533-4902-bba4-41d47a3d394d {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:00:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0433b01f-5533-4902-bba4-41d47a3d394d is timed out.
Nov 15 13:00:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully detached device vdb from instance 0433b01f-5533-4902-bba4-41d47a3d394d from the live domain config.
Nov 15 13:00:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZudCngyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:00:20 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:00:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc2e17a-2c58-410c-9cb2-922292277666]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:00:20 user nova-compute[75813]: No targets found.
Nov 15 13:00:20 user nova-compute[75813]: iSNS:
Nov 15 13:00:20 user nova-compute[75813]: No targets found.
Nov 15 13:00:20 user nova-compute[75813]: STATIC:
Nov 15 13:00:20 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e
Nov 15 13:00:20 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:00:20 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:00:20 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a
Nov 15 13:00:20 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:00:20 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:00:20 user nova-compute[75813]: FIRMWARE:
Nov 15 13:00:20 user nova-compute[75813]: No targets found.
Nov 15 13:00:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:00:20 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:00:20 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:00:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[87591659-2017-4d14-a28a-8f60d4362b81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b240b179-6147-41e5-90f3-b23a09a59e37]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:21 user nova-compute[75813]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e (non-flash)
Nov 15 13:00:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:21 user nova-compute[75813]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e (non-flash)
Nov 15 13:00:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55501c48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e'): ({'sdc'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Removing single pathed devices sdc {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e91e7a8-75d6-4a64-b88d-35490069ee02]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8378df4e-c3db-49ec-8568-41b4ed0cb1de]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Flushing IO for device /dev/sdc {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4452f66a-5608-4c87-a68b-5147299eccaa]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1245e0a-972e-49fd-8776-4443edd055b9]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebdd3c9-ad48-461e-9a91-ca739c57bdf5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[915879c0-d870-4acd-b37e-41d0ad1a3739]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e, portal: 172.16.0.220,3260]
Nov 15 13:00:21 user nova-compute[75813]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e, portal: 172.16.0.220,3260] successful.
Nov 15 13:00:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:091dff73-3dc9-429a-a54a-e457fba2a71e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[401a1eb3-d1bd-4254-85df-72ce06293597]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] <== disconnect_volume: return (307ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:00:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:00:22 user nova-compute[75813]: DEBUG nova.objects.instance [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'flavor' on Instance uuid 0433b01f-5533-4902-bba4-41d47a3d394d {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-49c93b24-4951-42a8-8987-ec83d25989c8 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:27 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:00:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:00:27 user nova-compute[75813]: INFO nova.compute.claims [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Claim successful on node user
Nov 15 13:00:27 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:00:27 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:00:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:27 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:00:27 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:00:27 user nova-compute[75813]: DEBUG nova.network.neutron [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:00:28 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:00:28 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:00:28 user nova-compute[75813]: DEBUG nova.policy [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07f52b120c2e46e2a8ca7eb83dafceca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '134cc574095942efb38b85068bc72bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:00:28 user nova-compute[75813]: INFO nova.virt.block_device [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Booting with blank volume at /dev/vda
Nov 15 13:00:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:29 user nova-compute[75813]: DEBUG nova.network.neutron [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Successfully created port: c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:00:29 user nova-compute[75813]: DEBUG nova.network.neutron [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Successfully updated port: c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:00:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:00:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquired lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:00:29 user nova-compute[75813]: DEBUG nova.network.neutron [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:00:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-5b839e4c-3277-4042-8926-7ad3f3b7c9cd req-fb461f76-642b-4c3b-a1b0-c37619f4623b service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-changed-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:00:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-5b839e4c-3277-4042-8926-7ad3f3b7c9cd req-fb461f76-642b-4c3b-a1b0-c37619f4623b service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Refreshing instance network info cache due to event network-changed-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:00:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5b839e4c-3277-4042-8926-7ad3f3b7c9cd req-fb461f76-642b-4c3b-a1b0-c37619f4623b service nova] Acquiring lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:00:29 user nova-compute[75813]: DEBUG nova.network.neutron [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:00:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:30 user nova-compute[75813]: DEBUG nova.network.neutron [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updating instance_info_cache with network_info: [{"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:00:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Releasing lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:00:30 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Instance network_info: |[{"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:00:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5b839e4c-3277-4042-8926-7ad3f3b7c9cd req-fb461f76-642b-4c3b-a1b0-c37619f4623b service nova] Acquired lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:00:30 user nova-compute[75813]: DEBUG nova.network.neutron [req-5b839e4c-3277-4042-8926-7ad3f3b7c9cd req-fb461f76-642b-4c3b-a1b0-c37619f4623b service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Refreshing network info cache for port c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:00:30 user nova-compute[75813]: DEBUG nova.network.neutron [req-5b839e4c-3277-4042-8926-7ad3f3b7c9cd req-fb461f76-642b-4c3b-a1b0-c37619f4623b service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updated VIF entry in instance network info cache for port c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:00:30 user nova-compute[75813]: DEBUG nova.network.neutron [req-5b839e4c-3277-4042-8926-7ad3f3b7c9cd req-fb461f76-642b-4c3b-a1b0-c37619f4623b service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updating instance_info_cache with network_info: [{"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:00:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5b839e4c-3277-4042-8926-7ad3f3b7c9cd req-fb461f76-642b-4c3b-a1b0-c37619f4623b service nova] Releasing lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG os_brick.utils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf538dd5-0fc7-4cd0-8acf-ad94cb52c7c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b27b946-7f9c-4ca9-9a03-a0111ada650e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[28330315-5640-4554-a987-5d5d97d1be5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7edf72f-287d-41f2-b6bc-c92dcf14ff92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:00:33 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:00:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fa31eb-cd5a-4a46-b663-b7a40a95bc10]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG os_brick.utils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:00:33 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updating existing volume attachment record: 77906faf-d964-442a-a1dd-d1852a8797d4 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:00:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:34 user nova-compute[75813]: INFO nova.compute.manager [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Unshelving
Nov 15 13:00:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:35 user nova-compute[75813]: INFO nova.virt.block_device [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Booting with volume 106603c8-fd70-43d5-bf39-d27c20b9259d at /dev/vda
Nov 15 13:00:35 user nova-compute[75813]: DEBUG os_brick.utils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9d63cf-6934-49e9-82eb-97b64e6dc20f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7516890d-12c8-4048-9cb2-632161707b8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[023de128-f210-4fd6-afac-790722b390f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d87676c-7569-4883-b802-ee167c1d6b67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:00:35 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:00:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31a29ce-3460-4dc9-abd9-4705f0dca1d8]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG os_brick.utils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:00:35 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating existing volume attachment record: c9b341ee-ce38-4595-bfe8-964a473741e5 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:00:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lazy-loading 'pci_requests' on Instance uuid be6a3a9f-c85c-4de8-b035-a4bead582c96 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lazy-loading 'numa_topology' on Instance uuid be6a3a9f-c85c-4de8-b035-a4bead582c96 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:00:42 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Creating image(s)
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Ensure instance console log exists: /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Start _get_guest_xml network_info=[{"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '77906faf-d964-442a-a1dd-d1852a8797d4', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDQuPdsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ae1ec46-9edc-477d-a9c1-2455a76bda4e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2276ac3-49cf-4b64-9579-43dac4a7f7db', 'serial': 'b2276ac3-49cf-4b64-9579-43dac4a7f7db'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:00:42 user nova-compute[75813]: INFO nova.compute.claims [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Claim successful on node user
Nov 15 13:00:42 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:00:42 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDQuPdsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:00:42 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:00:42 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:00:42 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e43b3c2-7b1e-4bce-a72d-3133e5c14497]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:00:42 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc43f5ca-270c-48ed-846d-156100a33289]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db] added
Nov 15 13:00:42 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[064c3a6f-e8b2-47bb-892e-85d33a00031b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f48a01-300e-449e-af22-419e480ae9d5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDQuPdsM {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDQuPdsM" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c7af0a-91e3-4090-a773-1a7564710136]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TDQuPdsM'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[050da519-a478-4c00-b2e6-7e74df0f76d4]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5dbb4f-6742-4596-b9d1-1d470c11ffb1]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:42 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:42 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[324b4f13-76c0-4cf1-b416-6775323b209e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db, portal: 172.16.0.220,3260]
Nov 15 13:00:42 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db, portal: 172.16.0.220,3260] successful.
Nov 15 13:00:42 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9428e5e3-711f-4524-8765-bec40493272d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa8761a-bbe4-4d3d-ae01-31b7a08b61f5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:43 user nova-compute[75813]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:43 user nova-compute[75813]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:43 user nova-compute[75813]: INFO nova.network.neutron [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating port 3319e5d9-873b-44f6-bdd3-613b8a0a111f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14168b3-9d8a-4150-b84a-44184baaf391]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDQuPdsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquired lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-2920aad0-efbc-4579-ac4e-865d44b990f1 req-7ac58a03-11de-4e98-b76e-caa9bbaa3546 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-changed-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-2920aad0-efbc-4579-ac4e-865d44b990f1 req-7ac58a03-11de-4e98-b76e-caa9bbaa3546 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Refreshing instance network info cache due to event network-changed-3319e5d9-873b-44f6-bdd3-613b8a0a111f. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:00:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2920aad0-efbc-4579-ac4e-865d44b990f1 req-7ac58a03-11de-4e98-b76e-caa9bbaa3546 service nova] Acquiring lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating instance_info_cache with network_info: [{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Releasing lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:00:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Creating image(s)
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Ensure instance console log exists: /opt/stack/data/nova/instances/be6a3a9f-c85c-4de8-b035-a4bead582c96/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Start _get_guest_xml network_info=[{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'c9b341ee-ce38-4595-bfe8-964a473741e5', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZVKXryl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be6a3a9f-c85c-4de8-b035-a4bead582c96', 'attached_at': '', 'detached_at': '', 'volume_id': '106603c8-fd70-43d5-bf39-d27c20b9259d', 'serial': '106603c8-fd70-43d5-bf39-d27c20b9259d'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2920aad0-efbc-4579-ac4e-865d44b990f1 req-7ac58a03-11de-4e98-b76e-caa9bbaa3546 service nova] Acquired lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.network.neutron [req-2920aad0-efbc-4579-ac4e-865d44b990f1 req-7ac58a03-11de-4e98-b76e-caa9bbaa3546 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Refreshing network info cache for port 3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:00:44 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:00:44 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lazy-loading 'vcpu_model' on Instance uuid be6a3a9f-c85c-4de8-b035-a4bead582c96 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23032353166626435', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032353166626435', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.objects.base [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Object Instance<be6a3a9f-c85c-4de8-b035-a4bead582c96> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZVKXryl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:00:44 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:00:44 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:00:44 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1912171362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1912171362',id=27,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-6ig6c18m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:00:28Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=4ae1ec46-9edc-477d-a9c1-2455a76bda4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:7a,bridge_name='br-int',has_traffic_filtering=True,id=c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ebe3e1-c2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.objects.instance [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ae1ec46-9edc-477d-a9c1-2455a76bda4e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:00:44 user nova-compute[75813]:   <uuid>4ae1ec46-9edc-477d-a9c1-2455a76bda4e</uuid>
Nov 15 13:00:44 user nova-compute[75813]:   <name>instance-0000001b</name>
Nov 15 13:00:44 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:00:44 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:00:44 user nova-compute[75813]:   <metadata>
Nov 15 13:00:44 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:00:44 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:00:44 user nova-compute[75813]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1912171362</nova:name>
Nov 15 13:00:44 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:00:42</nova:creationTime>
Nov 15 13:00:44 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:00:44 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:00:44 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:00:44 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:00:44 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:00:44 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:00:44 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:00:44 user nova-compute[75813]:       <nova:owner>
Nov 15 13:00:44 user nova-compute[75813]:         <nova:user uuid="07f52b120c2e46e2a8ca7eb83dafceca">tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member</nova:user>
Nov 15 13:00:44 user nova-compute[75813]:         <nova:project uuid="134cc574095942efb38b85068bc72bfe">tempest-ServerBootFromVolumeStableRescueTest-2006280819</nova:project>
Nov 15 13:00:44 user nova-compute[75813]:       </nova:owner>
Nov 15 13:00:44 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:00:44 user nova-compute[75813]:       <nova:ports>
Nov 15 13:00:44 user nova-compute[75813]:         <nova:port uuid="c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9">
Nov 15 13:00:44 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 13:00:44 user nova-compute[75813]:         </nova:port>
Nov 15 13:00:44 user nova-compute[75813]:       </nova:ports>
Nov 15 13:00:44 user nova-compute[75813]:     </nova:instance>
Nov 15 13:00:44 user nova-compute[75813]:   </metadata>
Nov 15 13:00:44 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:00:44 user nova-compute[75813]:     <system>
Nov 15 13:00:44 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:00:44 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:00:44 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:00:44 user nova-compute[75813]:       <entry name="serial">4ae1ec46-9edc-477d-a9c1-2455a76bda4e</entry>
Nov 15 13:00:44 user nova-compute[75813]:       <entry name="uuid">4ae1ec46-9edc-477d-a9c1-2455a76bda4e</entry>
Nov 15 13:00:44 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:00:44 user nova-compute[75813]:     </system>
Nov 15 13:00:44 user nova-compute[75813]:   </sysinfo>
Nov 15 13:00:44 user nova-compute[75813]:   <os>
Nov 15 13:00:44 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:00:44 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:00:44 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:00:44 user nova-compute[75813]:   </os>
Nov 15 13:00:44 user nova-compute[75813]:   <features>
Nov 15 13:00:44 user nova-compute[75813]:     <acpi/>
Nov 15 13:00:44 user nova-compute[75813]:     <apic/>
Nov 15 13:00:44 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:00:44 user nova-compute[75813]:   </features>
Nov 15 13:00:44 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:00:44 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:00:44 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:00:44 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:00:44 user nova-compute[75813]:   </clock>
Nov 15 13:00:44 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:00:44 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:00:44 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:00:44 user nova-compute[75813]:   </cpu>
Nov 15 13:00:44 user nova-compute[75813]:   <devices>
Nov 15 13:00:44 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:00:44 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:00:44 user nova-compute[75813]:       <source dev="/dev/sdc"/>
Nov 15 13:00:44 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:00:44 user nova-compute[75813]:       <serial>b2276ac3-49cf-4b64-9579-43dac4a7f7db</serial>
Nov 15 13:00:44 user nova-compute[75813]:     </disk>
Nov 15 13:00:44 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:00:44 user nova-compute[75813]:       <mac address="fa:16:3e:a4:51:7a"/>
Nov 15 13:00:44 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:00:44 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:00:44 user nova-compute[75813]:       <target dev="tapc8ebe3e1-c2"/>
Nov 15 13:00:44 user nova-compute[75813]:     </interface>
Nov 15 13:00:44 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:00:44 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/console.log" append="off"/>
Nov 15 13:00:44 user nova-compute[75813]:     </serial>
Nov 15 13:00:44 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:00:44 user nova-compute[75813]:     <video>
Nov 15 13:00:44 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:00:44 user nova-compute[75813]:     </video>
Nov 15 13:00:44 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:00:44 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:00:44 user nova-compute[75813]:     </rng>
Nov 15 13:00:44 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:00:44 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:00:44 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:00:44 user nova-compute[75813]:     </memballoon>
Nov 15 13:00:44 user nova-compute[75813]:   </devices>
Nov 15 13:00:44 user nova-compute[75813]: </domain>
Nov 15 13:00:44 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1912171362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1912171362',id=27,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-6ig6c18m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:00:28Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=4ae1ec46-9edc-477d-a9c1-2455a76bda4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:7a,bridge_name='br-int',has_traffic_filtering=True,id=c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ebe3e1-c2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_vif [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:7a,bridge_name='br-int',has_traffic_filtering=True,id=c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ebe3e1-c2') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be54f2e-d819-47e3-b399-fa7f20d49017]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:00:44 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8889e0fa-4fab-5c93-98a9-83afcabbc3c8', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8ebe3e1-c2, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8ebe3e1-c2, col_values=(('qos', UUID('fef94d04-cd9c-4e88-a620-645d03f5bb55')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8ebe3e1-c2, col_values=(('external_ids', {'iface-id': 'c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:51:7a', 'vm-uuid': '4ae1ec46-9edc-477d-a9c1-2455a76bda4e'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb42012-d081-4133-b7d0-e43560733627]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d] added
Nov 15 13:00:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:44 user nova-compute[75813]: INFO os_vif [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:7a,bridge_name='br-int',has_traffic_filtering=True,id=c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ebe3e1-c2')
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5255d212-29ab-48ce-831e-d00c8d379783]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01100ac-bf62-4fd4-b920-e6216d259e50]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZVKXryl {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZVKXryl" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8607bc5-7afa-4926-9dab-1d1f068ad500]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zZVKXryl'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No VIF found with MAC fa:16:3e:a4:51:7a, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[73225bf8-e403-4a57-a109-b9059e85bee8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e64c295-5e80-4da7-8404-99c6d40cf6fa]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:44 user nova-compute[75813]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:44 user nova-compute[75813]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a9e077-73cd-48aa-b161-83f04ea181e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260]
Nov 15 13:00:44 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260] successful.
Nov 15 13:00:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0880b3cd-29ba-42ef-9e8a-34ccbdf2b149]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4260c43c-3ab8-414b-b15c-44d9c3dffcfe]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:44 user nova-compute[75813]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:44 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:00:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:44 user nova-compute[75813]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:44 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:00:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e2459c-c460-4c0b-be50-d0ef72869d63]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZVKXryl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.network.neutron [req-2920aad0-efbc-4579-ac4e-865d44b990f1 req-7ac58a03-11de-4e98-b76e-caa9bbaa3546 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updated VIF entry in instance network info cache for port 3319e5d9-873b-44f6-bdd3-613b8a0a111f. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG nova.network.neutron [req-2920aad0-efbc-4579-ac4e-865d44b990f1 req-7ac58a03-11de-4e98-b76e-caa9bbaa3546 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating instance_info_cache with network_info: [{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:00:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2920aad0-efbc-4579-ac4e-865d44b990f1 req-7ac58a03-11de-4e98-b76e-caa9bbaa3546 service nova] Releasing lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23961633061303231', 'path': '/dev/sdd'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961633061303231', 'path': '/dev/sdd'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T12:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1098721025',display_name='tempest-TestShelveInstance-server-1098721025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1098721025',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-175836121',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05f529adeb6b4124af5c49898ea718e1',ramdisk_id='',reservation_id='r-5dos5dei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-758391741',owner_user_name='tempest-TestShelveInstance-758391741-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:00:35Z,user_data=None,user_id='364157f6888d42c88318ab5f31b8132d',uuid=be6a3a9f-c85c-4de8-b035-a4bead582c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converting VIF {"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lazy-loading 'pci_devices' on Instance uuid be6a3a9f-c85c-4de8-b035-a4bead582c96 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.objects.base [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Object Instance<be6a3a9f-c85c-4de8-b035-a4bead582c96> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:00:45 user nova-compute[75813]:   <uuid>be6a3a9f-c85c-4de8-b035-a4bead582c96</uuid>
Nov 15 13:00:45 user nova-compute[75813]:   <name>instance-00000014</name>
Nov 15 13:00:45 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:00:45 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:00:45 user nova-compute[75813]:   <metadata>
Nov 15 13:00:45 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:00:45 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:00:45 user nova-compute[75813]:       <nova:name>tempest-TestShelveInstance-server-1098721025</nova:name>
Nov 15 13:00:45 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:00:44</nova:creationTime>
Nov 15 13:00:45 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:00:45 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:00:45 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:00:45 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:00:45 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:00:45 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:00:45 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:00:45 user nova-compute[75813]:       <nova:owner>
Nov 15 13:00:45 user nova-compute[75813]:         <nova:user uuid="364157f6888d42c88318ab5f31b8132d">tempest-TestShelveInstance-758391741-project-member</nova:user>
Nov 15 13:00:45 user nova-compute[75813]:         <nova:project uuid="05f529adeb6b4124af5c49898ea718e1">tempest-TestShelveInstance-758391741</nova:project>
Nov 15 13:00:45 user nova-compute[75813]:       </nova:owner>
Nov 15 13:00:45 user nova-compute[75813]:       <nova:ports>
Nov 15 13:00:45 user nova-compute[75813]:         <nova:port uuid="3319e5d9-873b-44f6-bdd3-613b8a0a111f">
Nov 15 13:00:45 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 13:00:45 user nova-compute[75813]:         </nova:port>
Nov 15 13:00:45 user nova-compute[75813]:       </nova:ports>
Nov 15 13:00:45 user nova-compute[75813]:     </nova:instance>
Nov 15 13:00:45 user nova-compute[75813]:   </metadata>
Nov 15 13:00:45 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:00:45 user nova-compute[75813]:     <system>
Nov 15 13:00:45 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:00:45 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:00:45 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:00:45 user nova-compute[75813]:       <entry name="serial">be6a3a9f-c85c-4de8-b035-a4bead582c96</entry>
Nov 15 13:00:45 user nova-compute[75813]:       <entry name="uuid">be6a3a9f-c85c-4de8-b035-a4bead582c96</entry>
Nov 15 13:00:45 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:00:45 user nova-compute[75813]:     </system>
Nov 15 13:00:45 user nova-compute[75813]:   </sysinfo>
Nov 15 13:00:45 user nova-compute[75813]:   <os>
Nov 15 13:00:45 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:00:45 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:00:45 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:00:45 user nova-compute[75813]:   </os>
Nov 15 13:00:45 user nova-compute[75813]:   <features>
Nov 15 13:00:45 user nova-compute[75813]:     <acpi/>
Nov 15 13:00:45 user nova-compute[75813]:     <apic/>
Nov 15 13:00:45 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:00:45 user nova-compute[75813]:   </features>
Nov 15 13:00:45 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:00:45 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:00:45 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:00:45 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:00:45 user nova-compute[75813]:   </clock>
Nov 15 13:00:45 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:00:45 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:00:45 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:00:45 user nova-compute[75813]:   </cpu>
Nov 15 13:00:45 user nova-compute[75813]:   <devices>
Nov 15 13:00:45 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:00:45 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:00:45 user nova-compute[75813]:       <source dev="/dev/sdd"/>
Nov 15 13:00:45 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:00:45 user nova-compute[75813]:       <serial>106603c8-fd70-43d5-bf39-d27c20b9259d</serial>
Nov 15 13:00:45 user nova-compute[75813]:     </disk>
Nov 15 13:00:45 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:00:45 user nova-compute[75813]:       <mac address="fa:16:3e:fe:00:f3"/>
Nov 15 13:00:45 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:00:45 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:00:45 user nova-compute[75813]:       <target dev="tap3319e5d9-87"/>
Nov 15 13:00:45 user nova-compute[75813]:     </interface>
Nov 15 13:00:45 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:00:45 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/be6a3a9f-c85c-4de8-b035-a4bead582c96/console.log" append="off"/>
Nov 15 13:00:45 user nova-compute[75813]:     </serial>
Nov 15 13:00:45 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:00:45 user nova-compute[75813]:     <video>
Nov 15 13:00:45 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:00:45 user nova-compute[75813]:     </video>
Nov 15 13:00:45 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:00:45 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:00:45 user nova-compute[75813]:     </rng>
Nov 15 13:00:45 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:00:45 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:00:45 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:00:45 user nova-compute[75813]:     </memballoon>
Nov 15 13:00:45 user nova-compute[75813]:   </devices>
Nov 15 13:00:45 user nova-compute[75813]: </domain>
Nov 15 13:00:45 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T12:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1098721025',display_name='tempest-TestShelveInstance-server-1098721025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1098721025',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-175836121',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05f529adeb6b4124af5c49898ea718e1',ramdisk_id='',reservation_id='r-5dos5dei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-758391741',owner_user_name='tempest-TestShelveInstance-758391741-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:00:35Z,user_data=None,user_id='364157f6888d42c88318ab5f31b8132d',uuid=be6a3a9f-c85c-4de8-b035-a4bead582c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converting VIF {"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG os_vif [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1799c01-7eec-5d0c-8bd5-1ef3e22ba188', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3319e5d9-87, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3319e5d9-87, col_values=(('qos', UUID('4a0595a3-4199-4e0e-8180-2aee9061b588')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3319e5d9-87, col_values=(('external_ids', {'iface-id': '3319e5d9-873b-44f6-bdd3-613b8a0a111f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:00:f3', 'vm-uuid': 'be6a3a9f-c85c-4de8-b035-a4bead582c96'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:45 user nova-compute[75813]: INFO os_vif [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87')
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] No VIF found with MAC fa:16:3e:fe:00:f3, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updating instance_info_cache with network_info: [{"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-768bf717-a37e-4ca0-9564-62f694edfc74 req-3391290e-0ebc-404e-ae82-0c9b78d095d2 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-768bf717-a37e-4ca0-9564-62f694edfc74 req-3391290e-0ebc-404e-ae82-0c9b78d095d2 service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-768bf717-a37e-4ca0-9564-62f694edfc74 req-3391290e-0ebc-404e-ae82-0c9b78d095d2 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-768bf717-a37e-4ca0-9564-62f694edfc74 req-3391290e-0ebc-404e-ae82-0c9b78d095d2 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-768bf717-a37e-4ca0-9564-62f694edfc74 req-3391290e-0ebc-404e-ae82-0c9b78d095d2 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:00:45 user nova-compute[75813]: WARNING nova.compute.manager [req-768bf717-a37e-4ca0-9564-62f694edfc74 req-3391290e-0ebc-404e-ae82-0c9b78d095d2 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received unexpected event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with vm_state building and task_state spawning.
Nov 15 13:00:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:00:47 user nova-compute[75813]: WARNING nova.compute.manager [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received unexpected event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with vm_state building and task_state spawning.
Nov 15 13:00:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] No waiting events found dispatching network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:00:47 user nova-compute[75813]: WARNING nova.compute.manager [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received unexpected event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 13:00:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] No waiting events found dispatching network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:00:47 user nova-compute[75813]: WARNING nova.compute.manager [req-715bbb98-52f6-424f-a29e-32d757c37bf9 req-dcf592ff-d835-4071-9f4c-7a9a6ed25f90 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received unexpected event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 13:00:48 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:00:48 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:00:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:00:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:00:48 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Instance spawned successfully.
Nov 15 13:00:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:00:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:00:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:00:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:00:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:00:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:00:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:00:48 user nova-compute[75813]: INFO nova.compute.manager [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 15 13:00:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:00:48 user nova-compute[75813]: INFO nova.compute.manager [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Took 21.41 seconds to build instance.
Nov 15 13:00:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1aa12b46-4779-43c0-8f48-f60765c00cc8 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.500s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:49 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:00:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:00:49 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Instance spawned successfully.
Nov 15 13:00:49 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:00:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a83ee0fe-c933-478e-8e0c-19f03e2a3277 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.280s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "0433b01f-5533-4902-bba4-41d47a3d394d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:50 user nova-compute[75813]: INFO nova.compute.manager [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Terminating instance
Nov 15 13:00:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-840a38fb-cc8e-426e-a135-24703c4bfad4 req-f10a8aa8-c60a-49fe-93fc-3ee38b3be7bf service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Received event network-vif-unplugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-840a38fb-cc8e-426e-a135-24703c4bfad4 req-f10a8aa8-c60a-49fe-93fc-3ee38b3be7bf service nova] Acquiring lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-840a38fb-cc8e-426e-a135-24703c4bfad4 req-f10a8aa8-c60a-49fe-93fc-3ee38b3be7bf service nova] Lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-840a38fb-cc8e-426e-a135-24703c4bfad4 req-f10a8aa8-c60a-49fe-93fc-3ee38b3be7bf service nova] Lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-840a38fb-cc8e-426e-a135-24703c4bfad4 req-f10a8aa8-c60a-49fe-93fc-3ee38b3be7bf service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] No waiting events found dispatching network-vif-unplugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-840a38fb-cc8e-426e-a135-24703c4bfad4 req-f10a8aa8-c60a-49fe-93fc-3ee38b3be7bf service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Received event network-vif-unplugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Instance destroyed successfully.
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.objects.instance [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lazy-loading 'resources' on Instance uuid 0433b01f-5533-4902-bba4-41d47a3d394d {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2070014061',display_name='tempest-AttachVolumeNegativeTest-server-2070014061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2070014061',id=25,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeD/TqCfG/oOgf6xjcm8atBCjg+TwMuruS42zwMUwa+Ofjp7M3U6TC6ybx4l7GntqC9M8SFXxySrLmO0CEB9PNDYnnvEnnnp3+OAh8qyRsOXmgDXtv9Jcbm5P5zmyzhdg==',key_name='tempest-keypair-982632132',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:58:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cb2a7b27b904d639b7df886781d587f',ramdisk_id='',reservation_id='r-u1gfys8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1316863353',owner_user_name='tempest-AttachVolumeNegativeTest-1316863353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:58:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e8cb4b92ee40b9875ac675ec63b982',uuid=0433b01f-5533-4902-bba4-41d47a3d394d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "address": "fa:16:3e:f2:6f:97", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ced7d59-ee", "ovs_interfaceid": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converting VIF {"id": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "address": "fa:16:3e:f2:6f:97", "network": {"id": "d4951647-19bf-4614-b167-0e035459b1f9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088451824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cb2a7b27b904d639b7df886781d587f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ced7d59-ee", "ovs_interfaceid": "9ced7d59-eed0-45d0-bcc6-acd2a842c921", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=9ced7d59-eed0-45d0-bcc6-acd2a842c921,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ced7d59-ee') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG os_vif [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=9ced7d59-eed0-45d0-bcc6-acd2a842c921,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ced7d59-ee') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ced7d59-ee, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c2c43a6-c979-4602-bdbe-46ec11515941) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:51 user nova-compute[75813]: INFO os_vif [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=9ced7d59-eed0-45d0-bcc6-acd2a842c921,network=Network(d4951647-19bf-4614-b167-0e035459b1f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ced7d59-ee')
Nov 15 13:00:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Deleting instance files /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d_del
Nov 15 13:00:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Deletion of /opt/stack/data/nova/instances/0433b01f-5533-4902-bba4-41d47a3d394d_del complete
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:51 user nova-compute[75813]: INFO nova.compute.manager [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:52 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:00:52 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8386MB free_disk=25.259090423583984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:00:52 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Took 0.97 seconds to deallocate network for instance.
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-1fc16f02-5602-4fca-ab70-fffcada58fcc req-803a5f50-0af7-4575-a685-64dc49a929d1 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Received event network-vif-deleted-9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:00:52 user nova-compute[75813]: INFO nova.compute.manager [req-1fc16f02-5602-4fca-ab70-fffcada58fcc req-803a5f50-0af7-4575-a685-64dc49a929d1 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Neutron deleted interface 9ced7d59-eed0-45d0-bcc6-acd2a842c921; detaching it from the instance and deleting it from the info cache
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.network.neutron [req-1fc16f02-5602-4fca-ab70-fffcada58fcc req-803a5f50-0af7-4575-a685-64dc49a929d1 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-1fc16f02-5602-4fca-ab70-fffcada58fcc req-803a5f50-0af7-4575-a685-64dc49a929d1 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Detach interface failed, port_id=9ced7d59-eed0-45d0-bcc6-acd2a842c921, reason: Instance 0433b01f-5533-4902-bba4-41d47a3d394d could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 0433b01f-5533-4902-bba4-41d47a3d394d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 9fed6377-0614-41ae-b421-75d74da5fa4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance be6a3a9f-c85c-4de8-b035-a4bead582c96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:00:52 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.327s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG nova.compute.manager [req-c043b805-38c9-456d-8d6d-5ef8c244e226 req-bf5dd010-78d5-459c-ae77-f223f2357487 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Received event network-vif-plugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c043b805-38c9-456d-8d6d-5ef8c244e226 req-bf5dd010-78d5-459c-ae77-f223f2357487 service nova] Acquiring lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c043b805-38c9-456d-8d6d-5ef8c244e226 req-bf5dd010-78d5-459c-ae77-f223f2357487 service nova] Lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c043b805-38c9-456d-8d6d-5ef8c244e226 req-bf5dd010-78d5-459c-ae77-f223f2357487 service nova] Lock "0433b01f-5533-4902-bba4-41d47a3d394d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG nova.compute.manager [req-c043b805-38c9-456d-8d6d-5ef8c244e226 req-bf5dd010-78d5-459c-ae77-f223f2357487 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] No waiting events found dispatching network-vif-plugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:00:53 user nova-compute[75813]: WARNING nova.compute.manager [req-c043b805-38c9-456d-8d6d-5ef8c244e226 req-bf5dd010-78d5-459c-ae77-f223f2357487 service nova] [instance: 0433b01f-5533-4902-bba4-41d47a3d394d] Received unexpected event network-vif-plugged-9ced7d59-eed0-45d0-bcc6-acd2a842c921 for instance with vm_state deleted and task_state None.
Nov 15 13:00:53 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:53 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Deleted allocations for instance 0433b01f-5533-4902-bba4-41d47a3d394d
Nov 15 13:00:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5ea60ae0-41ef-4b41-9832-97df2ce57e33 tempest-AttachVolumeNegativeTest-1316863353 tempest-AttachVolumeNegativeTest-1316863353-project-member] Lock "0433b01f-5533-4902-bba4-41d47a3d394d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.758s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG nova.objects.instance [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquired lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG nova.network.neutron [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG nova.objects.instance [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'info_cache' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:53 user nova-compute[75813]: DEBUG nova.objects.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.network.neutron [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updating instance_info_cache with network_info: [{"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Releasing lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:00:54 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance destroyed successfully.
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.objects.instance [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'resources' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.objects.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1560614732',display_name='tempest-AttachVolumeTestJSON-server-1560614732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1560614732',id=21,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnbNba04CbeL7eAssBt/FmQ/iYfKbd5Suudux+Uq/+hDAu0UbaSznFUIXj3nEyetGtTpXd7+WYrSD1d+9oe6ooGQlSFefp1/qlmhmSqQ0sJ7qT77xL5D4H51OLc73q6+w==',key_name='tempest-keypair-1745276063',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-8n5drqmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=525b3797-8d57-4bff-8ad9-4d53a8beaea4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_vif [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8472db86-c1, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f0b7327-d8cb-49e3-9284-4864a896ead0) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:54 user nova-compute[75813]: INFO os_vif [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1')
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzSdGvTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:00:54 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebfcfc1-97e5-4613-912c-b628c4a48495]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:00:54 user nova-compute[75813]: No targets found.
Nov 15 13:00:54 user nova-compute[75813]: iSNS:
Nov 15 13:00:54 user nova-compute[75813]: No targets found.
Nov 15 13:00:54 user nova-compute[75813]: STATIC:
Nov 15 13:00:54 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:00:54 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:00:54 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:00:54 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d
Nov 15 13:00:54 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:00:54 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:00:54 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a
Nov 15 13:00:54 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:00:54 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:00:54 user nova-compute[75813]: FIRMWARE:
Nov 15 13:00:54 user nova-compute[75813]: No targets found.
Nov 15 13:00:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:00:54 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:00:54 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a869359-f6e8-4095-ae16-b46523d12572]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e2a778-5d32-4abc-92ca-98f22a8117f2]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:54 user nova-compute[75813]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:54 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:00:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:54 user nova-compute[75813]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:54 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:00:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55305ab520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[05168142-841c-45f7-902b-4592e752e9fd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea166327-f437-4f3a-a0c9-2d355b491ebc]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77e4c12-577c-45bb-9270-32e37b079954]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[96792fcc-3ffc-4ab9-8126-4959a69cf81b]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[345277fc-236d-4c2b-b44d-3019d8189287]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[424793fa-002a-456a-8326-9461378d9926]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260]
Nov 15 13:00:54 user nova-compute[75813]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260] successful.
Nov 15 13:00:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b9d82b-d3b2-40ef-8410-77b86928f03e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] <== disconnect_volume: return (299ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Start _get_guest_xml network_info=[{"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': 'aa7d59f9-bce2-470b-bcc2-6c1e0761208e', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzSdGvTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '525b3797-8d57-4bff-8ad9-4d53a8beaea4', 'attached_at': '', 'detached_at': '', 'volume_id': 'daa28342-d5e4-49c5-9366-b3debd9a522a', 'serial': 'daa28342-d5e4-49c5-9366-b3debd9a522a'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.objects.instance [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'numa_topology' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.objects.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:00:54 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:00:54 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.objects.instance [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'vcpu_model' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.objects.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzSdGvTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:00:54 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:00:54 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:00:54 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8063b22-afda-4d2d-81e4-d8f54aa6b21e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:00:54 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[212bf014-026e-4a4f-a01a-ccbf1d9bd19f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a] added
Nov 15 13:00:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b359f-5691-4d1c-ab77-1156c82aa8c7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea4a771-2880-4cb2-9b15-61373ae1e9bd]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzSdGvTm {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzSdGvTm" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c789511a-ba3b-4589-96e6-7db4837bd713]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DzSdGvTm'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5251192f-928e-4798-8a7c-816d554abf59]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e14f25b-bdaa-4c13-afa5-c42222fa1360]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:54 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:00:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:54 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:00:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:00:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d0c523-d0ff-4427-a996-e19211cead90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260]
Nov 15 13:00:55 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260] successful.
Nov 15 13:00:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2cc13b-0438-4e41-ac61-36f53e5fa376]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[26df5d68-35ee-4887-b021-84c7602c5f23]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:55 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:00:55 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:00:55 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:00:55 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:00:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[193b6d6b-20ca-486c-b93e-a70dd4411738]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:00:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzSdGvTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23163636330356636', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163636330356636', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1560614732',display_name='tempest-AttachVolumeTestJSON-server-1560614732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1560614732',id=21,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnbNba04CbeL7eAssBt/FmQ/iYfKbd5Suudux+Uq/+hDAu0UbaSznFUIXj3nEyetGtTpXd7+WYrSD1d+9oe6ooGQlSFefp1/qlmhmSqQ0sJ7qT77xL5D4H51OLc73q6+w==',key_name='tempest-keypair-1745276063',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-8n5drqmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=525b3797-8d57-4bff-8ad9-4d53a8beaea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.objects.instance [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'pci_devices' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.objects.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:00:56 user nova-compute[75813]:   <uuid>525b3797-8d57-4bff-8ad9-4d53a8beaea4</uuid>
Nov 15 13:00:56 user nova-compute[75813]:   <name>instance-00000015</name>
Nov 15 13:00:56 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:00:56 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:00:56 user nova-compute[75813]:   <metadata>
Nov 15 13:00:56 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:00:56 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:00:56 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeTestJSON-server-1560614732</nova:name>
Nov 15 13:00:56 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:00:54</nova:creationTime>
Nov 15 13:00:56 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:00:56 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:00:56 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:00:56 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:00:56 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:00:56 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:00:56 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:00:56 user nova-compute[75813]:       <nova:owner>
Nov 15 13:00:56 user nova-compute[75813]:         <nova:user uuid="f68d31c0d9bc4a66b3d81a892dee65ef">tempest-AttachVolumeTestJSON-45300677-project-member</nova:user>
Nov 15 13:00:56 user nova-compute[75813]:         <nova:project uuid="fc78719b197c4db7bc6a13e3a57f3cb2">tempest-AttachVolumeTestJSON-45300677</nova:project>
Nov 15 13:00:56 user nova-compute[75813]:       </nova:owner>
Nov 15 13:00:56 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:00:56 user nova-compute[75813]:       <nova:ports>
Nov 15 13:00:56 user nova-compute[75813]:         <nova:port uuid="8472db86-c1ef-4c6a-a878-5951fa94e2e1">
Nov 15 13:00:56 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 13:00:56 user nova-compute[75813]:         </nova:port>
Nov 15 13:00:56 user nova-compute[75813]:       </nova:ports>
Nov 15 13:00:56 user nova-compute[75813]:     </nova:instance>
Nov 15 13:00:56 user nova-compute[75813]:   </metadata>
Nov 15 13:00:56 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:00:56 user nova-compute[75813]:     <system>
Nov 15 13:00:56 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:00:56 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:00:56 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:00:56 user nova-compute[75813]:       <entry name="serial">525b3797-8d57-4bff-8ad9-4d53a8beaea4</entry>
Nov 15 13:00:56 user nova-compute[75813]:       <entry name="uuid">525b3797-8d57-4bff-8ad9-4d53a8beaea4</entry>
Nov 15 13:00:56 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:00:56 user nova-compute[75813]:     </system>
Nov 15 13:00:56 user nova-compute[75813]:   </sysinfo>
Nov 15 13:00:56 user nova-compute[75813]:   <os>
Nov 15 13:00:56 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:00:56 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:00:56 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:00:56 user nova-compute[75813]:   </os>
Nov 15 13:00:56 user nova-compute[75813]:   <features>
Nov 15 13:00:56 user nova-compute[75813]:     <acpi/>
Nov 15 13:00:56 user nova-compute[75813]:     <apic/>
Nov 15 13:00:56 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:00:56 user nova-compute[75813]:   </features>
Nov 15 13:00:56 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:00:56 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:00:56 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:00:56 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:00:56 user nova-compute[75813]:   </clock>
Nov 15 13:00:56 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:00:56 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:00:56 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:00:56 user nova-compute[75813]:   </cpu>
Nov 15 13:00:56 user nova-compute[75813]:   <devices>
Nov 15 13:00:56 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:00:56 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:00:56 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk"/>
Nov 15 13:00:56 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:00:56 user nova-compute[75813]:     </disk>
Nov 15 13:00:56 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:00:56 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:00:56 user nova-compute[75813]:       <source dev="/dev/sdb"/>
Nov 15 13:00:56 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 13:00:56 user nova-compute[75813]:       <serial>daa28342-d5e4-49c5-9366-b3debd9a522a</serial>
Nov 15 13:00:56 user nova-compute[75813]:     </disk>
Nov 15 13:00:56 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:00:56 user nova-compute[75813]:       <mac address="fa:16:3e:2f:03:54"/>
Nov 15 13:00:56 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:00:56 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:00:56 user nova-compute[75813]:       <target dev="tap8472db86-c1"/>
Nov 15 13:00:56 user nova-compute[75813]:     </interface>
Nov 15 13:00:56 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:00:56 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/console.log" append="off"/>
Nov 15 13:00:56 user nova-compute[75813]:     </serial>
Nov 15 13:00:56 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:00:56 user nova-compute[75813]:     <video>
Nov 15 13:00:56 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:00:56 user nova-compute[75813]:     </video>
Nov 15 13:00:56 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:00:56 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:00:56 user nova-compute[75813]:     </rng>
Nov 15 13:00:56 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:00:56 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:00:56 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:00:56 user nova-compute[75813]:     </memballoon>
Nov 15 13:00:56 user nova-compute[75813]:   </devices>
Nov 15 13:00:56 user nova-compute[75813]: </domain>
Nov 15 13:00:56 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.objects.instance [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'trusted_certs' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.objects.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Cannot resize image /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.objects.instance [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'migration_context' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.objects.base [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1560614732',display_name='tempest-AttachVolumeTestJSON-server-1560614732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1560614732',id=21,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnbNba04CbeL7eAssBt/FmQ/iYfKbd5Suudux+Uq/+hDAu0UbaSznFUIXj3nEyetGtTpXd7+WYrSD1d+9oe6ooGQlSFefp1/qlmhmSqQ0sJ7qT77xL5D4H51OLc73q6+w==',key_name='tempest-keypair-1745276063',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-8n5drqmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T12:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=525b3797-8d57-4bff-8ad9-4d53a8beaea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG os_vif [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3878150a-a48e-5455-9d92-d6557040766e', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8472db86-c1, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8472db86-c1, col_values=(('qos', UUID('dc5b6c12-e552-43f1-ab4a-89fab5c4f9ce')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8472db86-c1, col_values=(('external_ids', {'iface-id': '8472db86-c1ef-4c6a-a878-5951fa94e2e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:03:54', 'vm-uuid': '525b3797-8d57-4bff-8ad9-4d53a8beaea4'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:00:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:56 user nova-compute[75813]: INFO os_vif [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1')
Nov 15 13:00:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-26293482-07b3-4a56-ba85-f8028a36bdc8 req-2e8a333b-0a47-4bc8-a028-30645079cdc8 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:00:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-26293482-07b3-4a56-ba85-f8028a36bdc8 req-2e8a333b-0a47-4bc8-a028-30645079cdc8 service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:00:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-26293482-07b3-4a56-ba85-f8028a36bdc8 req-2e8a333b-0a47-4bc8-a028-30645079cdc8 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:00:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-26293482-07b3-4a56-ba85-f8028a36bdc8 req-2e8a333b-0a47-4bc8-a028-30645079cdc8 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:00:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-26293482-07b3-4a56-ba85-f8028a36bdc8 req-2e8a333b-0a47-4bc8-a028-30645079cdc8 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:00:58 user nova-compute[75813]: WARNING nova.compute.manager [req-26293482-07b3-4a56-ba85-f8028a36bdc8 req-2e8a333b-0a47-4bc8-a028-30645079cdc8 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received unexpected event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with vm_state stopped and task_state powering-on.
Nov 15 13:00:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:00:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:00 user nova-compute[75813]: DEBUG nova.compute.manager [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:01:00 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance rebooted successfully.
Nov 15 13:01:00 user nova-compute[75813]: DEBUG nova.compute.manager [None req-241082fc-0647-4eb5-8c52-ef663614d205 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:01:00 user nova-compute[75813]: DEBUG nova.compute.manager [req-405e2aaf-e3ec-4c31-9381-588a6d35daf0 req-4f010d40-66fa-4f4b-8a1f-9aa7acacfe82 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:01:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-405e2aaf-e3ec-4c31-9381-588a6d35daf0 req-4f010d40-66fa-4f4b-8a1f-9aa7acacfe82 service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-405e2aaf-e3ec-4c31-9381-588a6d35daf0 req-4f010d40-66fa-4f4b-8a1f-9aa7acacfe82 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-405e2aaf-e3ec-4c31-9381-588a6d35daf0 req-4f010d40-66fa-4f4b-8a1f-9aa7acacfe82 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:00 user nova-compute[75813]: DEBUG nova.compute.manager [req-405e2aaf-e3ec-4c31-9381-588a6d35daf0 req-4f010d40-66fa-4f4b-8a1f-9aa7acacfe82 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:01:00 user nova-compute[75813]: WARNING nova.compute.manager [req-405e2aaf-e3ec-4c31-9381-588a6d35daf0 req-4f010d40-66fa-4f4b-8a1f-9aa7acacfe82 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received unexpected event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with vm_state active and task_state None.
Nov 15 13:01:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:04 user nova-compute[75813]: INFO nova.compute.manager [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Unshelving
Nov 15 13:01:04 user nova-compute[75813]: INFO nova.virt.block_device [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Booting with volume 923cad8c-3442-475d-97b0-f67a8bd7b40a at /dev/vdc
Nov 15 13:01:05 user nova-compute[75813]: DEBUG os_brick.utils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c834b8e9-807d-4e57-a0a8-f8a1cd1a896b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e63ea92-e1e6-46e9-82e1-caef299a9b3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[80efdc5d-0238-4d6c-b1cc-6f2afbcc0725]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c58c98-ead3-4e31-9d63-c1aa9e3912ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:01:05 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:01:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d25938f-7a07-4bfa-9e98-85a00f8e262b]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG os_brick.utils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updating existing volume attachment record: a71d345a-ddc6-4efa-9128-9d871e18b9b0 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:01:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:10 user nova-compute[75813]: DEBUG nova.objects.instance [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'pci_requests' on Instance uuid 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:01:10 user nova-compute[75813]: DEBUG nova.objects.instance [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'numa_topology' on Instance uuid 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:01:10 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:01:10 user nova-compute[75813]: INFO nova.compute.claims [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Claim successful on node user
Nov 15 13:01:10 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:01:10 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:01:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:10 user nova-compute[75813]: INFO nova.network.neutron [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updating port d38d4cbb-3312-4630-a9e2-27a4dadec958 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 13:01:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquired lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG nova.network.neutron [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG nova.compute.manager [req-7b8ec152-60d1-48de-9f65-ec3a35f2c214 req-5917f1c5-2fe8-4d32-a2f3-0e030064f3b0 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-changed-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG nova.compute.manager [req-7b8ec152-60d1-48de-9f65-ec3a35f2c214 req-5917f1c5-2fe8-4d32-a2f3-0e030064f3b0 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Refreshing instance network info cache due to event network-changed-d38d4cbb-3312-4630-a9e2-27a4dadec958. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7b8ec152-60d1-48de-9f65-ec3a35f2c214 req-5917f1c5-2fe8-4d32-a2f3-0e030064f3b0 service nova] Acquiring lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG nova.network.neutron [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updating instance_info_cache with network_info: [{"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Releasing lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:01:11 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Creating image(s)
Nov 15 13:01:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "/opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "/opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "/opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG nova.objects.instance [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'trusted_certs' on Instance uuid 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7b8ec152-60d1-48de-9f65-ec3a35f2c214 req-5917f1c5-2fe8-4d32-a2f3-0e030064f3b0 service nova] Acquired lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG nova.network.neutron [req-7b8ec152-60d1-48de-9f65-ec3a35f2c214 req-5917f1c5-2fe8-4d32-a2f3-0e030064f3b0 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Refreshing network info cache for port d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG nova.objects.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Object Instance<933c225a-9ff5-406b-9600-6a90e738810c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "cb39bedcbd04d4af399c93a866d711b2693b0cbf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "cb39bedcbd04d4af399c93a866d711b2693b0cbf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf.part --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf.part --force-share --output=json" returned: 0 in 0.212s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:12 user nova-compute[75813]: DEBUG nova.virt.images [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] 4d57ae0b-9277-4548-9020-0d37be925cd6 was qcow2, converting to raw {{(pid=75813) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 13:01:12 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:01:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf.part /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf.converted {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:12 user nova-compute[75813]: DEBUG nova.network.neutron [req-7b8ec152-60d1-48de-9f65-ec3a35f2c214 req-5917f1c5-2fe8-4d32-a2f3-0e030064f3b0 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updated VIF entry in instance network info cache for port d38d4cbb-3312-4630-a9e2-27a4dadec958. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:01:12 user nova-compute[75813]: DEBUG nova.network.neutron [req-7b8ec152-60d1-48de-9f65-ec3a35f2c214 req-5917f1c5-2fe8-4d32-a2f3-0e030064f3b0 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updating instance_info_cache with network_info: [{"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:01:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7b8ec152-60d1-48de-9f65-ec3a35f2c214 req-5917f1c5-2fe8-4d32-a2f3-0e030064f3b0 service nova] Releasing lock "refresh_cache-933c225a-9ff5-406b-9600-6a90e738810c" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf.part /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf.converted" returned: 0 in 0.367s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf.converted --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "cb39bedcbd04d4af399c93a866d711b2693b0cbf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.546s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "cb39bedcbd04d4af399c93a866d711b2693b0cbf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "cb39bedcbd04d4af399c93a866d711b2693b0cbf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf,backing_fmt=raw /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf,backing_fmt=raw /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk 1073741824" returned: 0 in 0.046s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "cb39bedcbd04d4af399c93a866d711b2693b0cbf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG nova.objects.instance [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'migration_context' on Instance uuid 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:01:13 user nova-compute[75813]: DEBUG nova.objects.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Object Instance<933c225a-9ff5-406b-9600-6a90e738810c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:01:13 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Rebasing disk image.
Nov 15 13:01:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 -F raw /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 -F raw /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk" returned: 0 in 2.023s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Ensure instance console log exists: /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Start _get_guest_xml network_info=[{"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='bdb8c9422ac80bc72642afccd18c94c0',container_format='bare',created_at=2023-11-15T12:59:13Z,direct_url=<?>,disk_format='qcow2',id=4d57ae0b-9277-4548-9020-0d37be925cd6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-850952693-shelved',owner='8eaef11927a74bd4a8dfa8f6a11ab367',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T12:59:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'attachment_id': 'a71d345a-ddc6-4efa-9128-9d871e18b9b0', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFvSAHwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '933c225a-9ff5-406b-9600-6a90e738810c', 'attached_at': '', 'detached_at': '', 'volume_id': '923cad8c-3442-475d-97b0-f67a8bd7b40a', 'serial': '923cad8c-3442-475d-97b0-f67a8bd7b40a'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:01:16 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:01:16 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bdb8c9422ac80bc72642afccd18c94c0',container_format='bare',created_at=2023-11-15T12:59:13Z,direct_url=<?>,disk_format='qcow2',id=4d57ae0b-9277-4548-9020-0d37be925cd6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-850952693-shelved',owner='8eaef11927a74bd4a8dfa8f6a11ab367',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T12:59:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.objects.instance [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'vcpu_model' on Instance uuid 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.objects.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Object Instance<933c225a-9ff5-406b-9600-6a90e738810c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFvSAHwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:01:16 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:01:16 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:01:16 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[597525ed-18ad-4641-bfb5-28708760914c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:01:16 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aac581-e4ae-403b-8008-db948e02bdc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a] added
Nov 15 13:01:16 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04fb7f6-4356-49cf-98b9-eed9cb690644]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b55dbe-4cd5-42c4-a256-9ca71b566878]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFvSAHwI {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFvSAHwI" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc95403-8733-400a-8b88-45f12caf12e4]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PFvSAHwI'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a51ba8-eb7b-448a-8303-885cefd5dc72]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aad6b83-9e35-476a-b0e0-ed1d7cd20d8b]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:01:16 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:01:16 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:01:16 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:01:16 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:01:16 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:01:16 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0a661b-2b3d-485b-bf2e-60bd41bd7ba1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a, portal: 172.16.0.220,3260]
Nov 15 13:01:16 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a, portal: 172.16.0.220,3260] successful.
Nov 15 13:01:16 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca23d237-7e77-4b32-87c7-24bb9014d833]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3bd0f4-fba6-4803-a0e6-ea28d38998ac]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:01:16 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:01:16 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:01:16 user nova-compute[75813]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)
Nov 15 13:01:16 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:01:16 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:01:16 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:01:16 user nova-compute[75813]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)
Nov 15 13:01:16 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[241dd73c-cf97-4105-9ed6-cae7db9456cc]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:01:16 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFvSAHwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26233373666353563', 'path': '/dev/sde'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233373666353563', 'path': '/dev/sde'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T12:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-850952693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-850952693',id=22,image_ref='4d57ae0b-9277-4548-9020-0d37be925cd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1330676257',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-kdv40ajl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member',shelved_at='2023-11-15T12:59:17.505422',shelved_host='user',shelved_image_id='4d57ae0b-9277-4548-9020-0d37be925cd6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=933c225a-9ff5-406b-9600-6a90e738810c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.objects.instance [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'pci_devices' on Instance uuid 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.objects.base [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Object Instance<933c225a-9ff5-406b-9600-6a90e738810c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:01:17 user nova-compute[75813]:   <uuid>933c225a-9ff5-406b-9600-6a90e738810c</uuid>
Nov 15 13:01:17 user nova-compute[75813]:   <name>instance-00000016</name>
Nov 15 13:01:17 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:01:17 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:01:17 user nova-compute[75813]:   <metadata>
Nov 15 13:01:17 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:01:17 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:01:17 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-850952693</nova:name>
Nov 15 13:01:17 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:01:16</nova:creationTime>
Nov 15 13:01:17 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:01:17 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:01:17 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:01:17 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:01:17 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:01:17 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:01:17 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:01:17 user nova-compute[75813]:       <nova:owner>
Nov 15 13:01:17 user nova-compute[75813]:         <nova:user uuid="7f3642a668cd4e998ffbaf8f76f5d895">tempest-AttachVolumeShelveTestJSON-1167418523-project-member</nova:user>
Nov 15 13:01:17 user nova-compute[75813]:         <nova:project uuid="8eaef11927a74bd4a8dfa8f6a11ab367">tempest-AttachVolumeShelveTestJSON-1167418523</nova:project>
Nov 15 13:01:17 user nova-compute[75813]:       </nova:owner>
Nov 15 13:01:17 user nova-compute[75813]:       <nova:root type="image" uuid="4d57ae0b-9277-4548-9020-0d37be925cd6"/>
Nov 15 13:01:17 user nova-compute[75813]:       <nova:ports>
Nov 15 13:01:17 user nova-compute[75813]:         <nova:port uuid="d38d4cbb-3312-4630-a9e2-27a4dadec958">
Nov 15 13:01:17 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 13:01:17 user nova-compute[75813]:         </nova:port>
Nov 15 13:01:17 user nova-compute[75813]:       </nova:ports>
Nov 15 13:01:17 user nova-compute[75813]:     </nova:instance>
Nov 15 13:01:17 user nova-compute[75813]:   </metadata>
Nov 15 13:01:17 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:01:17 user nova-compute[75813]:     <system>
Nov 15 13:01:17 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:01:17 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:01:17 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:01:17 user nova-compute[75813]:       <entry name="serial">933c225a-9ff5-406b-9600-6a90e738810c</entry>
Nov 15 13:01:17 user nova-compute[75813]:       <entry name="uuid">933c225a-9ff5-406b-9600-6a90e738810c</entry>
Nov 15 13:01:17 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:01:17 user nova-compute[75813]:     </system>
Nov 15 13:01:17 user nova-compute[75813]:   </sysinfo>
Nov 15 13:01:17 user nova-compute[75813]:   <os>
Nov 15 13:01:17 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:01:17 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:01:17 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:01:17 user nova-compute[75813]:   </os>
Nov 15 13:01:17 user nova-compute[75813]:   <features>
Nov 15 13:01:17 user nova-compute[75813]:     <acpi/>
Nov 15 13:01:17 user nova-compute[75813]:     <apic/>
Nov 15 13:01:17 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:01:17 user nova-compute[75813]:   </features>
Nov 15 13:01:17 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:01:17 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:01:17 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:01:17 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:01:17 user nova-compute[75813]:   </clock>
Nov 15 13:01:17 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:01:17 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:01:17 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:01:17 user nova-compute[75813]:   </cpu>
Nov 15 13:01:17 user nova-compute[75813]:   <devices>
Nov 15 13:01:17 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:01:17 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:01:17 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk"/>
Nov 15 13:01:17 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:01:17 user nova-compute[75813]:     </disk>
Nov 15 13:01:17 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:01:17 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:01:17 user nova-compute[75813]:       <source dev="/dev/sde"/>
Nov 15 13:01:17 user nova-compute[75813]:       <target dev="vdc" bus="virtio"/>
Nov 15 13:01:17 user nova-compute[75813]:       <serial>923cad8c-3442-475d-97b0-f67a8bd7b40a</serial>
Nov 15 13:01:17 user nova-compute[75813]:     </disk>
Nov 15 13:01:17 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:01:17 user nova-compute[75813]:       <mac address="fa:16:3e:25:19:36"/>
Nov 15 13:01:17 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:01:17 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:01:17 user nova-compute[75813]:       <target dev="tapd38d4cbb-33"/>
Nov 15 13:01:17 user nova-compute[75813]:     </interface>
Nov 15 13:01:17 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:01:17 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/console.log" append="off"/>
Nov 15 13:01:17 user nova-compute[75813]:     </serial>
Nov 15 13:01:17 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:01:17 user nova-compute[75813]:     <video>
Nov 15 13:01:17 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:01:17 user nova-compute[75813]:     </video>
Nov 15 13:01:17 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:01:17 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:01:17 user nova-compute[75813]:     </rng>
Nov 15 13:01:17 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:01:17 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:01:17 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:01:17 user nova-compute[75813]:     </memballoon>
Nov 15 13:01:17 user nova-compute[75813]:   </devices>
Nov 15 13:01:17 user nova-compute[75813]: </domain>
Nov 15 13:01:17 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T12:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-850952693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-850952693',id=22,image_ref='4d57ae0b-9277-4548-9020-0d37be925cd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1330676257',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-kdv40ajl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member',shelved_at='2023-11-15T12:59:17.505422',shelved_host='user',shelved_image_id='4d57ae0b-9277-4548-9020-0d37be925cd6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=933c225a-9ff5-406b-9600-6a90e738810c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG os_vif [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2880f582-7143-55f2-9259-4c9c1b211241', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd38d4cbb-33, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd38d4cbb-33, col_values=(('qos', UUID('2282a0e8-6495-4075-b91a-23aae7950b1a')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd38d4cbb-33, col_values=(('external_ids', {'iface-id': 'd38d4cbb-3312-4630-a9e2-27a4dadec958', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:19:36', 'vm-uuid': '933c225a-9ff5-406b-9600-6a90e738810c'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:17 user nova-compute[75813]: INFO os_vif [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33')
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:01:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] No VIF found with MAC fa:16:3e:25:19:36, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:01:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-86f16b1a-7ac2-4f7d-a6a8-af683fcd543d req-54d0668d-4e10-45fe-8e33-c74fed47c980 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:01:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-86f16b1a-7ac2-4f7d-a6a8-af683fcd543d req-54d0668d-4e10-45fe-8e33-c74fed47c980 service nova] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-86f16b1a-7ac2-4f7d-a6a8-af683fcd543d req-54d0668d-4e10-45fe-8e33-c74fed47c980 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-86f16b1a-7ac2-4f7d-a6a8-af683fcd543d req-54d0668d-4e10-45fe-8e33-c74fed47c980 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-86f16b1a-7ac2-4f7d-a6a8-af683fcd543d req-54d0668d-4e10-45fe-8e33-c74fed47c980 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] No waiting events found dispatching network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:01:19 user nova-compute[75813]: WARNING nova.compute.manager [req-86f16b1a-7ac2-4f7d-a6a8-af683fcd543d req-54d0668d-4e10-45fe-8e33-c74fed47c980 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received unexpected event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 13:01:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-ec5705c6-2390-4f17-9c2b-6705401f48a0 req-e5e55672-b872-4d43-b748-df9071e466c5 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:01:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ec5705c6-2390-4f17-9c2b-6705401f48a0 req-e5e55672-b872-4d43-b748-df9071e466c5 service nova] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ec5705c6-2390-4f17-9c2b-6705401f48a0 req-e5e55672-b872-4d43-b748-df9071e466c5 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ec5705c6-2390-4f17-9c2b-6705401f48a0 req-e5e55672-b872-4d43-b748-df9071e466c5 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-ec5705c6-2390-4f17-9c2b-6705401f48a0 req-e5e55672-b872-4d43-b748-df9071e466c5 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] No waiting events found dispatching network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:01:21 user nova-compute[75813]: WARNING nova.compute.manager [req-ec5705c6-2390-4f17-9c2b-6705401f48a0 req-e5e55672-b872-4d43-b748-df9071e466c5 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received unexpected event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 13:01:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:01:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:01:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Instance spawned successfully.
Nov 15 13:01:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:01:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-82c3b19c-5b4c-4596-ac1b-1c82e97b661f tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.700s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-7957c470-1109-47ad-ac30-423563022335 req-0e632d92-67b0-436d-ab67-120c1a4f1680 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-changed-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:01:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-7957c470-1109-47ad-ac30-423563022335 req-0e632d92-67b0-436d-ab67-120c1a4f1680 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Refreshing instance network info cache due to event network-changed-0855cbc5-0088-42fb-be12-422784a52b93. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:01:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7957c470-1109-47ad-ac30-423563022335 req-0e632d92-67b0-436d-ab67-120c1a4f1680 service nova] Acquiring lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:01:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7957c470-1109-47ad-ac30-423563022335 req-0e632d92-67b0-436d-ab67-120c1a4f1680 service nova] Acquired lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:01:23 user nova-compute[75813]: DEBUG nova.network.neutron [req-7957c470-1109-47ad-ac30-423563022335 req-0e632d92-67b0-436d-ab67-120c1a4f1680 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Refreshing network info cache for port 0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:01:23 user nova-compute[75813]: DEBUG nova.network.neutron [req-7957c470-1109-47ad-ac30-423563022335 req-0e632d92-67b0-436d-ab67-120c1a4f1680 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updated VIF entry in instance network info cache for port 0855cbc5-0088-42fb-be12-422784a52b93. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:01:23 user nova-compute[75813]: DEBUG nova.network.neutron [req-7957c470-1109-47ad-ac30-423563022335 req-0e632d92-67b0-436d-ab67-120c1a4f1680 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updating instance_info_cache with network_info: [{"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:01:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7957c470-1109-47ad-ac30-423563022335 req-0e632d92-67b0-436d-ab67-120c1a4f1680 service nova] Releasing lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:01:24 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:01:24 user nova-compute[75813]: INFO nova.compute.manager [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] instance snapshotting
Nov 15 13:01:24 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Beginning live snapshot process
Nov 15 13:01:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json -f qcow2 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json -f qcow2 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4xcxwmqw/857797a7639b48c3b0fe89253605b9f0.delta 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4xcxwmqw/857797a7639b48c3b0fe89253605b9f0.delta 1073741824" returned: 0 in 0.044s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 13:01:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 13:01:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 13:01:26 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 13:01:26 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:01:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4xcxwmqw/857797a7639b48c3b0fe89253605b9f0.delta /opt/stack/data/nova/instances/snapshots/tmp4xcxwmqw/857797a7639b48c3b0fe89253605b9f0 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4xcxwmqw/857797a7639b48c3b0fe89253605b9f0.delta /opt/stack/data/nova/instances/snapshots/tmp4xcxwmqw/857797a7639b48c3b0fe89253605b9f0" returned: 0 in 0.505s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:27 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Snapshot extracted, beginning image upload
Nov 15 13:01:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:30 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Snapshot image upload complete
Nov 15 13:01:30 user nova-compute[75813]: INFO nova.compute.manager [None req-d00560cc-f92f-44a9-be17-b1a058c8e3e7 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Took 5.51 seconds to snapshot the instance on the hypervisor.
Nov 15 13:01:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:01:40 user nova-compute[75813]: INFO nova.compute.claims [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Claim successful on node user
Nov 15 13:01:40 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:01:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:01:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:01:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Creating image(s)
Nov 15 13:01:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "/opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "/opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "/opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG nova.policy [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2b3f74a69954ecf8d5cce188f5fc043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ae639fa3444ba0be3d480b8572a0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.167s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk 1073741824" returned: 0 in 0.044s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Successfully created port: 51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Cannot resize image /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Ensure instance console log exists: /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Successfully updated port: 51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "refresh_cache-01c3ee8c-322c-42c6-8c33-22ae16e77c46" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquired lock "refresh_cache-01c3ee8c-322c-42c6-8c33-22ae16e77c46" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-74224445-f2ba-4c57-aa71-cdfa1b32e84a req-f7326dfb-e376-4800-ad61-dd0897a49ca6 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-changed-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-74224445-f2ba-4c57-aa71-cdfa1b32e84a req-f7326dfb-e376-4800-ad61-dd0897a49ca6 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Refreshing instance network info cache due to event network-changed-51b054cd-cd32-4efa-9b1f-4b6257025c45. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74224445-f2ba-4c57-aa71-cdfa1b32e84a req-f7326dfb-e376-4800-ad61-dd0897a49ca6 service nova] Acquiring lock "refresh_cache-01c3ee8c-322c-42c6-8c33-22ae16e77c46" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Updating instance_info_cache with network_info: [{"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Releasing lock "refresh_cache-01c3ee8c-322c-42c6-8c33-22ae16e77c46" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Instance network_info: |[{"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74224445-f2ba-4c57-aa71-cdfa1b32e84a req-f7326dfb-e376-4800-ad61-dd0897a49ca6 service nova] Acquired lock "refresh_cache-01c3ee8c-322c-42c6-8c33-22ae16e77c46" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.network.neutron [req-74224445-f2ba-4c57-aa71-cdfa1b32e84a req-f7326dfb-e376-4800-ad61-dd0897a49ca6 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Refreshing network info cache for port 51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Start _get_guest_xml network_info=[{"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:01:42 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:01:42 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-347681257',display_name='tempest-tempest.common.compute-instance-347681257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-347681257',id=28,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWQ0qmhy85GCBxBGKQ9gZY2Ij6XIXZ3e/Cefm0CoRTimt6Q7nvDlRwdtiaKTZS3e9QvWhzJJ7QwsM+NlsX4ZLpkyPKST4L/BpcsrIqva0sn5bllqIOgT8Pqn7YOrF5QTw==',key_name='tempest-keypair-1734348321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-m5s0icbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=01c3ee8c-322c-42c6-8c33-22ae16e77c46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'pci_devices' on Instance uuid 01c3ee8c-322c-42c6-8c33-22ae16e77c46 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:01:42 user nova-compute[75813]:   <uuid>01c3ee8c-322c-42c6-8c33-22ae16e77c46</uuid>
Nov 15 13:01:42 user nova-compute[75813]:   <name>instance-0000001c</name>
Nov 15 13:01:42 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:01:42 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:01:42 user nova-compute[75813]:   <metadata>
Nov 15 13:01:42 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:01:42 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:01:42 user nova-compute[75813]:       <nova:name>tempest-tempest.common.compute-instance-347681257</nova:name>
Nov 15 13:01:42 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:01:42</nova:creationTime>
Nov 15 13:01:42 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:01:42 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:01:42 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:01:42 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:01:42 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:01:42 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:01:42 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:01:42 user nova-compute[75813]:       <nova:owner>
Nov 15 13:01:42 user nova-compute[75813]:         <nova:user uuid="c2b3f74a69954ecf8d5cce188f5fc043">tempest-ServerActionsTestOtherA-1826218173-project-member</nova:user>
Nov 15 13:01:42 user nova-compute[75813]:         <nova:project uuid="76ae639fa3444ba0be3d480b8572a0e6">tempest-ServerActionsTestOtherA-1826218173</nova:project>
Nov 15 13:01:42 user nova-compute[75813]:       </nova:owner>
Nov 15 13:01:42 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:01:42 user nova-compute[75813]:       <nova:ports>
Nov 15 13:01:42 user nova-compute[75813]:         <nova:port uuid="51b054cd-cd32-4efa-9b1f-4b6257025c45">
Nov 15 13:01:42 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 13:01:42 user nova-compute[75813]:         </nova:port>
Nov 15 13:01:42 user nova-compute[75813]:       </nova:ports>
Nov 15 13:01:42 user nova-compute[75813]:     </nova:instance>
Nov 15 13:01:42 user nova-compute[75813]:   </metadata>
Nov 15 13:01:42 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:01:42 user nova-compute[75813]:     <system>
Nov 15 13:01:42 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:01:42 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:01:42 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:01:42 user nova-compute[75813]:       <entry name="serial">01c3ee8c-322c-42c6-8c33-22ae16e77c46</entry>
Nov 15 13:01:42 user nova-compute[75813]:       <entry name="uuid">01c3ee8c-322c-42c6-8c33-22ae16e77c46</entry>
Nov 15 13:01:42 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:01:42 user nova-compute[75813]:     </system>
Nov 15 13:01:42 user nova-compute[75813]:   </sysinfo>
Nov 15 13:01:42 user nova-compute[75813]:   <os>
Nov 15 13:01:42 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:01:42 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:01:42 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:01:42 user nova-compute[75813]:   </os>
Nov 15 13:01:42 user nova-compute[75813]:   <features>
Nov 15 13:01:42 user nova-compute[75813]:     <acpi/>
Nov 15 13:01:42 user nova-compute[75813]:     <apic/>
Nov 15 13:01:42 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:01:42 user nova-compute[75813]:   </features>
Nov 15 13:01:42 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:01:42 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:01:42 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:01:42 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:01:42 user nova-compute[75813]:   </clock>
Nov 15 13:01:42 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:01:42 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:01:42 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:01:42 user nova-compute[75813]:   </cpu>
Nov 15 13:01:42 user nova-compute[75813]:   <devices>
Nov 15 13:01:42 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:01:42 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:01:42 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk"/>
Nov 15 13:01:42 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:01:42 user nova-compute[75813]:     </disk>
Nov 15 13:01:42 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:01:42 user nova-compute[75813]:       <mac address="fa:16:3e:3c:4a:8e"/>
Nov 15 13:01:42 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:01:42 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:01:42 user nova-compute[75813]:       <target dev="tap51b054cd-cd"/>
Nov 15 13:01:42 user nova-compute[75813]:     </interface>
Nov 15 13:01:42 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:01:42 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/console.log" append="off"/>
Nov 15 13:01:42 user nova-compute[75813]:     </serial>
Nov 15 13:01:42 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:01:42 user nova-compute[75813]:     <video>
Nov 15 13:01:42 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:01:42 user nova-compute[75813]:     </video>
Nov 15 13:01:42 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:01:42 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:01:42 user nova-compute[75813]:     </rng>
Nov 15 13:01:42 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:01:42 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:01:42 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:01:42 user nova-compute[75813]:     </memballoon>
Nov 15 13:01:42 user nova-compute[75813]:   </devices>
Nov 15 13:01:42 user nova-compute[75813]: </domain>
Nov 15 13:01:42 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-347681257',display_name='tempest-tempest.common.compute-instance-347681257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-347681257',id=28,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWQ0qmhy85GCBxBGKQ9gZY2Ij6XIXZ3e/Cefm0CoRTimt6Q7nvDlRwdtiaKTZS3e9QvWhzJJ7QwsM+NlsX4ZLpkyPKST4L/BpcsrIqva0sn5bllqIOgT8Pqn7YOrF5QTw==',key_name='tempest-keypair-1734348321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-m5s0icbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=01c3ee8c-322c-42c6-8c33-22ae16e77c46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG os_vif [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f28d381d-67fa-501b-947d-18d2b3e05f63', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51b054cd-cd, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51b054cd-cd, col_values=(('qos', UUID('2e5d9989-9340-4377-b7cb-12bae30e730f')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51b054cd-cd, col_values=(('external_ids', {'iface-id': '51b054cd-cd32-4efa-9b1f-4b6257025c45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:4a:8e', 'vm-uuid': '01c3ee8c-322c-42c6-8c33-22ae16e77c46'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:42 user nova-compute[75813]: INFO os_vif [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd')
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No VIF found with MAC fa:16:3e:3c:4a:8e, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.network.neutron [req-74224445-f2ba-4c57-aa71-cdfa1b32e84a req-f7326dfb-e376-4800-ad61-dd0897a49ca6 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Updated VIF entry in instance network info cache for port 51b054cd-cd32-4efa-9b1f-4b6257025c45. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG nova.network.neutron [req-74224445-f2ba-4c57-aa71-cdfa1b32e84a req-f7326dfb-e376-4800-ad61-dd0897a49ca6 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Updating instance_info_cache with network_info: [{"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:01:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74224445-f2ba-4c57-aa71-cdfa1b32e84a req-f7326dfb-e376-4800-ad61-dd0897a49ca6 service nova] Releasing lock "refresh_cache-01c3ee8c-322c-42c6-8c33-22ae16e77c46" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:01:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-36103470-1d90-453e-85b9-9943a758f68e req-34d6c4cb-150f-44d6-8057-0caa4dce0c97 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:01:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-36103470-1d90-453e-85b9-9943a758f68e req-34d6c4cb-150f-44d6-8057-0caa4dce0c97 service nova] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-36103470-1d90-453e-85b9-9943a758f68e req-34d6c4cb-150f-44d6-8057-0caa4dce0c97 service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-36103470-1d90-453e-85b9-9943a758f68e req-34d6c4cb-150f-44d6-8057-0caa4dce0c97 service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-36103470-1d90-453e-85b9-9943a758f68e req-34d6c4cb-150f-44d6-8057-0caa4dce0c97 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] No waiting events found dispatching network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:01:44 user nova-compute[75813]: WARNING nova.compute.manager [req-36103470-1d90-453e-85b9-9943a758f68e req-34d6c4cb-150f-44d6-8057-0caa4dce0c97 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received unexpected event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 for instance with vm_state building and task_state spawning.
Nov 15 13:01:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Skipping network cache update for instance because it is Building. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updating instance_info_cache with network_info: [{"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:01:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:01:46 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Instance spawned successfully.
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:01:46 user nova-compute[75813]: INFO nova.compute.manager [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:01:46 user nova-compute[75813]: INFO nova.compute.manager [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Took 6.17 seconds to build instance.
Nov 15 13:01:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a4a88bd4-c497-4dbe-b734-9c900edc1913 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.337s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-6f766397-9a52-40b0-bd8b-6cc98bd38c6a req-85555872-bc31-4adb-ba4f-533ec0e89f64 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6f766397-9a52-40b0-bd8b-6cc98bd38c6a req-85555872-bc31-4adb-ba4f-533ec0e89f64 service nova] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6f766397-9a52-40b0-bd8b-6cc98bd38c6a req-85555872-bc31-4adb-ba4f-533ec0e89f64 service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6f766397-9a52-40b0-bd8b-6cc98bd38c6a req-85555872-bc31-4adb-ba4f-533ec0e89f64 service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-6f766397-9a52-40b0-bd8b-6cc98bd38c6a req-85555872-bc31-4adb-ba4f-533ec0e89f64 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] No waiting events found dispatching network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:01:46 user nova-compute[75813]: WARNING nova.compute.manager [req-6f766397-9a52-40b0-bd8b-6cc98bd38c6a req-85555872-bc31-4adb-ba4f-533ec0e89f64 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received unexpected event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 for instance with vm_state active and task_state None.
Nov 15 13:01:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:48 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:01:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:01:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:01:49 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:01:50 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:01:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:51 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:01:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:01:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:01:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:01:55 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:01:55 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8158MB free_disk=25.200908660888672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 9fed6377-0614-41ae-b421-75d74da5fa4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance be6a3a9f-c85c-4de8-b035-a4bead582c96 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 933c225a-9ff5-406b-9600-6a90e738810c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:01:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:01:56 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:01:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:18 user nova-compute[75813]: INFO nova.compute.manager [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Rescuing
Nov 15 13:02:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:02:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquired lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:02:18 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:02:18 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updating instance_info_cache with network_info: [{"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:02:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Releasing lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-5c892485-833c-42d5-b703-5a46f9f4f8e3 req-350621fc-48ee-4bb5-9d57-c31466715e64 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-unplugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c892485-833c-42d5-b703-5a46f9f4f8e3 req-350621fc-48ee-4bb5-9d57-c31466715e64 service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c892485-833c-42d5-b703-5a46f9f4f8e3 req-350621fc-48ee-4bb5-9d57-c31466715e64 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c892485-833c-42d5-b703-5a46f9f4f8e3 req-350621fc-48ee-4bb5-9d57-c31466715e64 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-5c892485-833c-42d5-b703-5a46f9f4f8e3 req-350621fc-48ee-4bb5-9d57-c31466715e64 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-unplugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:02:19 user nova-compute[75813]: WARNING nova.compute.manager [req-5c892485-833c-42d5-b703-5a46f9f4f8e3 req-350621fc-48ee-4bb5-9d57-c31466715e64 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received unexpected event network-vif-unplugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with vm_state active and task_state rescuing.
Nov 15 13:02:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:19 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Instance destroyed successfully.
Nov 15 13:02:19 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Attempting a stable device rescue
Nov 15 13:02:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75813) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Instance directory exists: not creating {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 13:02:19 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Creating image(s)
Nov 15 13:02:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "/opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "/opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4ae1ec46-9edc-477d-a9c1-2455a76bda4e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "aaaa33383a33d02153481d34b2df9ea69e6401d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "aaaa33383a33d02153481d34b2df9ea69e6401d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7.part --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7.part --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:20 user nova-compute[75813]: DEBUG nova.virt.images [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] 996141fe-6c74-4a87-8e18-b9891dfb48b6 was qcow2, converting to raw {{(pid=75813) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 13:02:20 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:02:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7.part /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7.converted {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7.part /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7.converted" returned: 0 in 0.227s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7.converted --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "aaaa33383a33d02153481d34b2df9ea69e6401d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.553s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "aaaa33383a33d02153481d34b2df9ea69e6401d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "aaaa33383a33d02153481d34b2df9ea69e6401d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-1024df6a-ef69-4811-b53f-769a60b37b9a req-545f4f0c-b4dd-4aca-a281-316a37faf361 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1024df6a-ef69-4811-b53f-769a60b37b9a req-545f4f0c-b4dd-4aca-a281-316a37faf361 service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1024df6a-ef69-4811-b53f-769a60b37b9a req-545f4f0c-b4dd-4aca-a281-316a37faf361 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1024df6a-ef69-4811-b53f-769a60b37b9a req-545f4f0c-b4dd-4aca-a281-316a37faf361 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-1024df6a-ef69-4811-b53f-769a60b37b9a req-545f4f0c-b4dd-4aca-a281-316a37faf361 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:02:21 user nova-compute[75813]: WARNING nova.compute.manager [req-1024df6a-ef69-4811-b53f-769a60b37b9a req-545f4f0c-b4dd-4aca-a281-316a37faf361 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received unexpected event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with vm_state active and task_state rescuing.
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7 --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7,backing_fmt=raw /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.rescue {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7,backing_fmt=raw /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.rescue" returned: 0 in 0.047s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "aaaa33383a33d02153481d34b2df9ea69e6401d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'migration_context' on Instance uuid 4ae1ec46-9edc-477d-a9c1-2455a76bda4e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.objects.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Object Instance<4ae1ec46-9edc-477d-a9c1-2455a76bda4e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Start _get_guest_xml network_info=[{"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "vif_mac": "fa:16:3e:a4:51:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '996141fe-6c74-4a87-8e18-b9891dfb48b6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '77906faf-d964-442a-a1dd-d1852a8797d4', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDQuPdsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4ae1ec46-9edc-477d-a9c1-2455a76bda4e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2276ac3-49cf-4b64-9579-43dac4a7f7db', 'serial': 'b2276ac3-49cf-4b64-9579-43dac4a7f7db'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'resources' on Instance uuid 4ae1ec46-9edc-477d-a9c1-2455a76bda4e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.objects.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Object Instance<4ae1ec46-9edc-477d-a9c1-2455a76bda4e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'numa_topology' on Instance uuid 4ae1ec46-9edc-477d-a9c1-2455a76bda4e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.objects.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Object Instance<4ae1ec46-9edc-477d-a9c1-2455a76bda4e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:02:21 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:02:21 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4ae1ec46-9edc-477d-a9c1-2455a76bda4e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.objects.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Object Instance<4ae1ec46-9edc-477d-a9c1-2455a76bda4e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDQuPdsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:02:21 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:02:21 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:02:21 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260" returned: 0 in 0.043s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d8a41d-a325-4c5a-9a84-3bca67339006]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TDQuPdsM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 13:02:21 user nova-compute[75813]: node.name = iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:02:21 user nova-compute[75813]: node.tpgt = -1
Nov 15 13:02:21 user nova-compute[75813]: node.startup = automatic
Nov 15 13:02:21 user nova-compute[75813]: node.leading_login = No
Nov 15 13:02:21 user nova-compute[75813]: iface.iscsi_ifacename = default
Nov 15 13:02:21 user nova-compute[75813]: iface.net_ifacename = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.ipaddress = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.prefix_len = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.hwaddress = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.transport_name = tcp
Nov 15 13:02:21 user nova-compute[75813]: iface.initiatorname = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.state = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.vlan_id = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.vlan_priority = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.vlan_state = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.iface_num = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.mtu = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.port = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.bootproto = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.subnet_mask = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.gateway = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.dhcp_alt_client_id = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.dhcp_dns = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.dhcp_learn_iqn = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.dhcp_vendor_id_state = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.dhcp_vendor_id = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.dhcp_slp_da = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.fragmentation = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.gratuitous_arp = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.incoming_forwarding = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.tos_state = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.tos = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.ttl = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.delayed_ack = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.tcp_nagle = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.tcp_wsf_state = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.tcp_wsf = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.tcp_timer_scale = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.tcp_timestamp = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.redirect = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.def_task_mgmt_timeout = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.header_digest = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.data_digest = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.immediate_data = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.initial_r2t = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.data_seq_inorder = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.data_pdu_inorder = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.erl = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.max_receive_data_len = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.first_burst_len = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.max_outstanding_r2t = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.max_burst_len = 0
Nov 15 13:02:21 user nova-compute[75813]: iface.chap_auth = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.bidi_chap = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.strict_login_compliance = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.discovery_auth = <empty>
Nov 15 13:02:21 user nova-compute[75813]: iface.discovery_logout = <empty>
Nov 15 13:02:21 user nova-compute[75813]: node.discovery_address = <empty>
Nov 15 13:02:21 user nova-compute[75813]: node.discovery_port = 0
Nov 15 13:02:21 user nova-compute[75813]: node.discovery_type = static
Nov 15 13:02:21 user nova-compute[75813]: node.session.initial_cmdsn = 0
Nov 15 13:02:21 user nova-compute[75813]: node.session.initial_login_retry_max = 8
Nov 15 13:02:21 user nova-compute[75813]: node.session.xmit_thread_priority = -20
Nov 15 13:02:21 user nova-compute[75813]: node.session.cmds_max = 128
Nov 15 13:02:21 user nova-compute[75813]: node.session.queue_depth = 32
Nov 15 13:02:21 user nova-compute[75813]: node.session.nr_sessions = 1
Nov 15 13:02:21 user nova-compute[75813]: node.session.auth.authmethod = CHAP
Nov 15 13:02:21 user nova-compute[75813]: node.session.auth.username = TDQuPdsM
Nov 15 13:02:21 user nova-compute[75813]: node.session.auth.password = ***
Nov 15 13:02:21 user nova-compute[75813]: node.session.auth.username_in = <empty>
Nov 15 13:02:21 user nova-compute[75813]: node.session.auth.password_in = <empty>
Nov 15 13:02:21 user nova-compute[75813]: node.session.auth.chap_algs = MD5
Nov 15 13:02:21 user nova-compute[75813]: node.session.timeo.replacement_timeout = 120
Nov 15 13:02:21 user nova-compute[75813]: node.session.err_timeo.abort_timeout = 15
Nov 15 13:02:21 user nova-compute[75813]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 13:02:21 user nova-compute[75813]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 13:02:21 user nova-compute[75813]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 13:02:21 user nova-compute[75813]: node.session.iscsi.FastAbort = Yes
Nov 15 13:02:21 user nova-compute[75813]: node.session.iscsi.InitialR2T = No
Nov 15 13:02:21 user nova-compute[75813]: node.session.iscsi.ImmediateData = Yes
Nov 15 13:02:21 user nova-compute[75813]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 13:02:21 user nova-compute[75813]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 13:02:21 user nova-compute[75813]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 13:02:21 user nova-compute[75813]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 13:02:21 user nova-compute[75813]: node.session.iscsi.MaxConnections = 1
Nov 15 13:02:21 user nova-compute[75813]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 13:02:21 user nova-compute[75813]: node.session.iscsi.ERL = 0
Nov 15 13:02:21 user nova-compute[75813]: node.session.scan = manual
Nov 15 13:02:21 user nova-compute[75813]: node.session.reopen_max = 0
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].address = 172.16.0.220
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].port = 3260
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].startup = manual
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].tcp.window_size = 524288
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].tcp.type_of_service = 0
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].timeo.logout_timeout = 15
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].timeo.login_timeout = 15
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].timeo.auth_timeout = 45
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].iscsi.DataDigest = None
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].iscsi.IFMarker = No
Nov 15 13:02:21 user nova-compute[75813]: node.conn[0].iscsi.OFMarker = No
Nov 15 13:02:21 user nova-compute[75813]: # END RECORD
Nov 15 13:02:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c258fc-9925-40b9-8675-b5884cc67c92]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac19503d-263a-46ce-8e99-cadb60a5ff48]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDQuPdsM {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDQuPdsM" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[447257bd-5de8-4ef9-8e5f-c49b4439e815]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TDQuPdsM'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6193fa78-b237-43e8-8a66-5a8fe4bb6184]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbc32b7-380b-4548-98bc-11df2b5ed0ee]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:02:21 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:02:21 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:02:21 user nova-compute[75813]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)
Nov 15 13:02:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:02:21 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:02:21 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:02:21 user nova-compute[75813]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)
Nov 15 13:02:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.194s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] HCTL ('34', '0', '0', 0) found on session 33 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7a398f-053d-4607-be56-f71e4d485e3e]: (4, ('0 0 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching for a device in session 33 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDQuPdsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.218s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] <== connect_volume: return (220ms) {'type': 'block', 'scsi_wwn': '23032353166626435', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032353166626435', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1912171362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1912171362',id=27,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-6ig6c18m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:00:49Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=4ae1ec46-9edc-477d-a9c1-2455a76bda4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "vif_mac": "fa:16:3e:a4:51:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "vif_mac": "fa:16:3e:a4:51:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:51:7a,bridge_name='br-int',has_traffic_filtering=True,id=c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ebe3e1-c2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ae1ec46-9edc-477d-a9c1-2455a76bda4e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.objects.base [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Object Instance<4ae1ec46-9edc-477d-a9c1-2455a76bda4e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:02:21 user nova-compute[75813]:   <uuid>4ae1ec46-9edc-477d-a9c1-2455a76bda4e</uuid>
Nov 15 13:02:21 user nova-compute[75813]:   <name>instance-0000001b</name>
Nov 15 13:02:21 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:02:21 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:02:21 user nova-compute[75813]:   <metadata>
Nov 15 13:02:21 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:02:21 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:02:21 user nova-compute[75813]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1912171362</nova:name>
Nov 15 13:02:21 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:02:21</nova:creationTime>
Nov 15 13:02:21 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:02:21 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:02:21 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:02:21 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:02:21 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:02:21 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:02:21 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:02:21 user nova-compute[75813]:       <nova:owner>
Nov 15 13:02:21 user nova-compute[75813]:         <nova:user uuid="07f52b120c2e46e2a8ca7eb83dafceca">tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member</nova:user>
Nov 15 13:02:21 user nova-compute[75813]:         <nova:project uuid="134cc574095942efb38b85068bc72bfe">tempest-ServerBootFromVolumeStableRescueTest-2006280819</nova:project>
Nov 15 13:02:21 user nova-compute[75813]:       </nova:owner>
Nov 15 13:02:21 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:02:21 user nova-compute[75813]:       <nova:ports>
Nov 15 13:02:21 user nova-compute[75813]:         <nova:port uuid="c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9">
Nov 15 13:02:21 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 13:02:21 user nova-compute[75813]:         </nova:port>
Nov 15 13:02:21 user nova-compute[75813]:       </nova:ports>
Nov 15 13:02:21 user nova-compute[75813]:     </nova:instance>
Nov 15 13:02:21 user nova-compute[75813]:   </metadata>
Nov 15 13:02:21 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:02:21 user nova-compute[75813]:     <system>
Nov 15 13:02:21 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:02:21 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:02:21 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:02:21 user nova-compute[75813]:       <entry name="serial">4ae1ec46-9edc-477d-a9c1-2455a76bda4e</entry>
Nov 15 13:02:21 user nova-compute[75813]:       <entry name="uuid">4ae1ec46-9edc-477d-a9c1-2455a76bda4e</entry>
Nov 15 13:02:21 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:02:21 user nova-compute[75813]:     </system>
Nov 15 13:02:21 user nova-compute[75813]:   </sysinfo>
Nov 15 13:02:21 user nova-compute[75813]:   <os>
Nov 15 13:02:21 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:02:21 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:02:21 user nova-compute[75813]:   </os>
Nov 15 13:02:21 user nova-compute[75813]:   <features>
Nov 15 13:02:21 user nova-compute[75813]:     <acpi/>
Nov 15 13:02:21 user nova-compute[75813]:     <apic/>
Nov 15 13:02:21 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:02:21 user nova-compute[75813]:   </features>
Nov 15 13:02:21 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:02:21 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:02:21 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:02:21 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:02:21 user nova-compute[75813]:   </clock>
Nov 15 13:02:21 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:02:21 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:02:21 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:02:21 user nova-compute[75813]:   </cpu>
Nov 15 13:02:21 user nova-compute[75813]:   <devices>
Nov 15 13:02:21 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:02:21 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:02:21 user nova-compute[75813]:       <source dev="/dev/sdc"/>
Nov 15 13:02:21 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:02:21 user nova-compute[75813]:       <serial>b2276ac3-49cf-4b64-9579-43dac4a7f7db</serial>
Nov 15 13:02:21 user nova-compute[75813]:     </disk>
Nov 15 13:02:21 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:02:21 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:02:21 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.rescue"/>
Nov 15 13:02:21 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 13:02:21 user nova-compute[75813]:       <boot order="1"/>
Nov 15 13:02:21 user nova-compute[75813]:     </disk>
Nov 15 13:02:21 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:02:21 user nova-compute[75813]:       <mac address="fa:16:3e:a4:51:7a"/>
Nov 15 13:02:21 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:02:21 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:02:21 user nova-compute[75813]:       <target dev="tapc8ebe3e1-c2"/>
Nov 15 13:02:21 user nova-compute[75813]:     </interface>
Nov 15 13:02:21 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:02:21 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/console.log" append="off"/>
Nov 15 13:02:21 user nova-compute[75813]:     </serial>
Nov 15 13:02:21 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:02:21 user nova-compute[75813]:     <video>
Nov 15 13:02:21 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:02:21 user nova-compute[75813]:     </video>
Nov 15 13:02:21 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:02:21 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:02:21 user nova-compute[75813]:     </rng>
Nov 15 13:02:21 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:02:21 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:02:21 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:02:21 user nova-compute[75813]:     </memballoon>
Nov 15 13:02:21 user nova-compute[75813]:   </devices>
Nov 15 13:02:21 user nova-compute[75813]: </domain>
Nov 15 13:02:21 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:02:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Instance destroyed successfully.
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:02:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No VIF found with MAC fa:16:3e:a4:51:7a, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:02:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-4021ca22-2c82-4352-bad7-8d78e3b3ddfc req-7a1008fe-c0ff-4069-9670-fc2188243342 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:02:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4021ca22-2c82-4352-bad7-8d78e3b3ddfc req-7a1008fe-c0ff-4069-9670-fc2188243342 service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4021ca22-2c82-4352-bad7-8d78e3b3ddfc req-7a1008fe-c0ff-4069-9670-fc2188243342 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4021ca22-2c82-4352-bad7-8d78e3b3ddfc req-7a1008fe-c0ff-4069-9670-fc2188243342 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-4021ca22-2c82-4352-bad7-8d78e3b3ddfc req-7a1008fe-c0ff-4069-9670-fc2188243342 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:02:23 user nova-compute[75813]: WARNING nova.compute.manager [req-4021ca22-2c82-4352-bad7-8d78e3b3ddfc req-7a1008fe-c0ff-4069-9670-fc2188243342 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received unexpected event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with vm_state active and task_state rescuing.
Nov 15 13:02:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-1c0f57cf-f94c-4f3d-9c6e-abe790defed6 req-f5c628dc-ddea-45fd-9e0e-68e33e8be6ef service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:02:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1c0f57cf-f94c-4f3d-9c6e-abe790defed6 req-f5c628dc-ddea-45fd-9e0e-68e33e8be6ef service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1c0f57cf-f94c-4f3d-9c6e-abe790defed6 req-f5c628dc-ddea-45fd-9e0e-68e33e8be6ef service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1c0f57cf-f94c-4f3d-9c6e-abe790defed6 req-f5c628dc-ddea-45fd-9e0e-68e33e8be6ef service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-1c0f57cf-f94c-4f3d-9c6e-abe790defed6 req-f5c628dc-ddea-45fd-9e0e-68e33e8be6ef service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:02:25 user nova-compute[75813]: WARNING nova.compute.manager [req-1c0f57cf-f94c-4f3d-9c6e-abe790defed6 req-f5c628dc-ddea-45fd-9e0e-68e33e8be6ef service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received unexpected event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with vm_state active and task_state rescuing.
Nov 15 13:02:25 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d7a73c44-ca13-4b52-8c0e-f1e30420761d tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:02:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-0735fdde-a983-4ff8-a567-9c867decd73e req-d6ab0133-3152-465e-9b4e-37e65ea7d0c8 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-changed-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-0735fdde-a983-4ff8-a567-9c867decd73e req-d6ab0133-3152-465e-9b4e-37e65ea7d0c8 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Refreshing instance network info cache due to event network-changed-3319e5d9-873b-44f6-bdd3-613b8a0a111f. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0735fdde-a983-4ff8-a567-9c867decd73e req-d6ab0133-3152-465e-9b4e-37e65ea7d0c8 service nova] Acquiring lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0735fdde-a983-4ff8-a567-9c867decd73e req-d6ab0133-3152-465e-9b4e-37e65ea7d0c8 service nova] Acquired lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG nova.network.neutron [req-0735fdde-a983-4ff8-a567-9c867decd73e req-d6ab0133-3152-465e-9b4e-37e65ea7d0c8 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Refreshing network info cache for port 3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:26 user nova-compute[75813]: INFO nova.compute.manager [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Terminating instance
Nov 15 13:02:26 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG nova.network.neutron [req-0735fdde-a983-4ff8-a567-9c867decd73e req-d6ab0133-3152-465e-9b4e-37e65ea7d0c8 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updated VIF entry in instance network info cache for port 3319e5d9-873b-44f6-bdd3-613b8a0a111f. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG nova.network.neutron [req-0735fdde-a983-4ff8-a567-9c867decd73e req-d6ab0133-3152-465e-9b4e-37e65ea7d0c8 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating instance_info_cache with network_info: [{"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0735fdde-a983-4ff8-a567-9c867decd73e req-d6ab0133-3152-465e-9b4e-37e65ea7d0c8 service nova] Releasing lock "refresh_cache-be6a3a9f-c85c-4de8-b035-a4bead582c96" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:02:26 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Instance destroyed successfully.
Nov 15 13:02:26 user nova-compute[75813]: DEBUG nova.objects.instance [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lazy-loading 'resources' on Instance uuid be6a3a9f-c85c-4de8-b035-a4bead582c96 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T12:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1098721025',display_name='tempest-TestShelveInstance-server-1098721025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1098721025',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7N7MsxwT9JHHOFY9/PU8NI9pb7YXiy99jSoN272W+h+mOZ1+NJCSLRF4zDMoW1GoNvbRiXMBTud9XsJi3Zb6Vv5F32/zy56U70aKYebYlSDUaUmernScIGry8ivWyy6g==',key_name='tempest-TestShelveInstance-175836121',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:00:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f529adeb6b4124af5c49898ea718e1',ramdisk_id='',reservation_id='r-5dos5dei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-758391741',owner_user_name='tempest-TestShelveInstance-758391741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:00:49Z,user_data=None,user_id='364157f6888d42c88318ab5f31b8132d',uuid=be6a3a9f-c85c-4de8-b035-a4bead582c96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converting VIF {"id": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "address": "fa:16:3e:fe:00:f3", "network": {"id": "94c0f63d-16a7-4f11-8325-0996d1868f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-330046436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f529adeb6b4124af5c49898ea718e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319e5d9-87", "ovs_interfaceid": "3319e5d9-873b-44f6-bdd3-613b8a0a111f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG os_vif [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3319e5d9-87, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a0595a3-4199-4e0e-8180-2aee9061b588) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:26 user nova-compute[75813]: INFO os_vif [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=3319e5d9-873b-44f6-bdd3-613b8a0a111f,network=Network(94c0f63d-16a7-4f11-8325-0996d1868f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319e5d9-87')
Nov 15 13:02:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZVKXryl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:02:26 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:02:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:02:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f91779b-3295-4ea6-b39d-edb444256fb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:02:27 user nova-compute[75813]: No targets found.
Nov 15 13:02:27 user nova-compute[75813]: iSNS:
Nov 15 13:02:27 user nova-compute[75813]: No targets found.
Nov 15 13:02:27 user nova-compute[75813]: STATIC:
Nov 15 13:02:27 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:02:27 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:02:27 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:02:27 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d
Nov 15 13:02:27 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:02:27 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:02:27 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a
Nov 15 13:02:27 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:02:27 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:02:27 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a
Nov 15 13:02:27 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:02:27 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:02:27 user nova-compute[75813]: FIRMWARE:
Nov 15 13:02:27 user nova-compute[75813]: No targets found.
Nov 15 13:02:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:02:27 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:02:27 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3c9f12-e8f4-4ccb-8f9a-1ae41e7e0c39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a83c46b-b342-4558-a36b-6ce3ca3cc6ee]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:02:27 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:02:27 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:02:27 user nova-compute[75813]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)
Nov 15 13:02:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:02:27 user nova-compute[75813]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d (non-flash)
Nov 15 13:02:27 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:02:27 user nova-compute[75813]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)
Nov 15 13:02:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550404430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d'): ({'sdd'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Removing single pathed devices sdd {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[31abdb5f-dc1b-4f6c-9d6a-cb989aa20357]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[536f62fd-45f4-408d-9e34-2621c3805440]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Flushing IO for device /dev/sdd {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ec8d1b-d382-4bb8-9892-a7c4e5ce2c58]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[322dfbe1-5a19-4c8f-8405-f003987a86d6]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23961633061303231', '/dev/disk/by-id/scsi-1SCST_BIOee1e6de7-9ac0a021b97197e2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ee1e6de7') {{(pid=87167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[be114c3e-cb88-4c8a-87a0-e8cd99986064]: (4, None) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0a3ec9-3655-40fd-809f-a4e9d8479a12]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1952045-560b-4b87-9700-a695ac73d7f2]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260]
Nov 15 13:02:27 user nova-compute[75813]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d, portal: 172.16.0.220,3260] successful.
Nov 15 13:02:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106603c8-fd70-43d5-bf39-d27c20b9259d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2823f8-f219-42a2-9a1b-bc1f446086a1]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] <== disconnect_volume: return (359ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:02:27 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Deleting instance files /opt/stack/data/nova/instances/be6a3a9f-c85c-4de8-b035-a4bead582c96_del
Nov 15 13:02:27 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Deletion of /opt/stack/data/nova/instances/be6a3a9f-c85c-4de8-b035-a4bead582c96_del complete
Nov 15 13:02:27 user nova-compute[75813]: INFO nova.compute.manager [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-vif-unplugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] No waiting events found dispatching network-vif-unplugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-vif-unplugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] Acquiring lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] No waiting events found dispatching network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:02:27 user nova-compute[75813]: WARNING nova.compute.manager [req-83f8a0fb-eab5-4c1b-8a00-d7164d38e593 req-3d771017-092d-44a0-8b30-2ac1b648ea5d service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received unexpected event network-vif-plugged-3319e5d9-873b-44f6-bdd3-613b8a0a111f for instance with vm_state active and task_state deleting.
Nov 15 13:02:28 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:02:28 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Took 0.70 seconds to deallocate network for instance.
Nov 15 13:02:28 user nova-compute[75813]: INFO nova.compute.manager [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Took 0.84 seconds to detach 1 volumes for instance.
Nov 15 13:02:28 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Deleting volume: 106603c8-fd70-43d5-bf39-d27c20b9259d {{(pid=75813) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 13:02:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:29 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:02:29 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:02:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:29 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Deleted allocations for instance be6a3a9f-c85c-4de8-b035-a4bead582c96
Nov 15 13:02:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6830579b-aab3-4522-b6ac-2f1b073416c1 tempest-TestShelveInstance-758391741 tempest-TestShelveInstance-758391741-project-member] Lock "be6a3a9f-c85c-4de8-b035-a4bead582c96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.490s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-c98d9d8a-ed73-4990-86ba-6235f45e3224 req-f55a66d2-2ac7-48d5-afde-30af62f0d457 service nova] [instance: be6a3a9f-c85c-4de8-b035-a4bead582c96] Received event network-vif-deleted-3319e5d9-873b-44f6-bdd3-613b8a0a111f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:02:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:45 user nova-compute[75813]: INFO nova.compute.manager [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Detaching volume daa28342-d5e4-49c5-9366-b3debd9a522a
Nov 15 13:02:45 user nova-compute[75813]: INFO nova.virt.block_device [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Attempting to driver detach volume daa28342-d5e4-49c5-9366-b3debd9a522a from mountpoint /dev/vdb
Nov 15 13:02:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Attempting to detach device vdb from instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:02:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:02:45 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:02:45 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:02:45 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:02:45 user nova-compute[75813]:   <serial>daa28342-d5e4-49c5-9366-b3debd9a522a</serial>
Nov 15 13:02:45 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 13:02:45 user nova-compute[75813]: </disk>
Nov 15 13:02:45 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:02:45 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully detached device vdb from instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 from the persistent domain config.
Nov 15 13:02:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:02:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:02:45 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:02:45 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:02:45 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:02:45 user nova-compute[75813]:   <serial>daa28342-d5e4-49c5-9366-b3debd9a522a</serial>
Nov 15 13:02:45 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 13:02:45 user nova-compute[75813]: </disk>
Nov 15 13:02:45 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:02:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:02:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:02:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:02:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:02:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:02:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:02:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updating instance_info_cache with network_info: [{"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:02:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:02:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:02:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:02:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:02:49 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:02:50 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:02:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:51 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:02:51 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:02:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:02:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:55 user nova-compute[75813]: INFO nova.compute.manager [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Detaching volume 923cad8c-3442-475d-97b0-f67a8bd7b40a
Nov 15 13:02:55 user nova-compute[75813]: INFO nova.virt.block_device [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Attempting to driver detach volume 923cad8c-3442-475d-97b0-f67a8bd7b40a from mountpoint /dev/vdc
Nov 15 13:02:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Attempting to detach device vdc from instance 933c225a-9ff5-406b-9600-6a90e738810c from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:02:55 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:02:55 user nova-compute[75813]:   <source dev="/dev/sde"/>
Nov 15 13:02:55 user nova-compute[75813]:   <target dev="vdc" bus="virtio"/>
Nov 15 13:02:55 user nova-compute[75813]:   <serial>923cad8c-3442-475d-97b0-f67a8bd7b40a</serial>
Nov 15 13:02:55 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 13:02:55 user nova-compute[75813]: </disk>
Nov 15 13:02:55 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:02:55 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Successfully detached device vdc from instance 933c225a-9ff5-406b-9600-6a90e738810c from the persistent domain config.
Nov 15 13:02:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 933c225a-9ff5-406b-9600-6a90e738810c from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:02:55 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:02:55 user nova-compute[75813]:   <source dev="/dev/sde"/>
Nov 15 13:02:55 user nova-compute[75813]:   <target dev="vdc" bus="virtio"/>
Nov 15 13:02:55 user nova-compute[75813]:   <serial>923cad8c-3442-475d-97b0-f67a8bd7b40a</serial>
Nov 15 13:02:55 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 13:02:55 user nova-compute[75813]: </disk>
Nov 15 13:02:55 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:02:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:02:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:02:57 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:02:57 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8077MB free_disk=25.065475463867188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 9fed6377-0614-41ae-b421-75d74da5fa4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 933c225a-9ff5-406b-9600-6a90e738810c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:02:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:05 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 is timed out.
Nov 15 13:03:05 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully detached device vdb from instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 from the live domain config.
Nov 15 13:03:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:03:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzSdGvTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:05 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:03:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9920fa-1e4c-405d-91f6-417918bf85c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:03:05 user nova-compute[75813]: No targets found.
Nov 15 13:03:05 user nova-compute[75813]: iSNS:
Nov 15 13:03:05 user nova-compute[75813]: No targets found.
Nov 15 13:03:05 user nova-compute[75813]: STATIC:
Nov 15 13:03:05 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:03:05 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:03:05 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:03:05 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a
Nov 15 13:03:05 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:03:05 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:03:05 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a
Nov 15 13:03:05 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:03:05 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:03:05 user nova-compute[75813]: FIRMWARE:
Nov 15 13:03:05 user nova-compute[75813]: No targets found.
Nov 15 13:03:05 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:03:05 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:03:05 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:03:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:03:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3d2c45-9329-477f-8b73-e6a03f6283d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8935e71-aa4e-4e3c-8d33-d135807cb36a]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:06 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:03:06 user nova-compute[75813]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)
Nov 15 13:03:06 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:06 user nova-compute[75813]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a (non-flash)
Nov 15 13:03:06 user nova-compute[75813]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)
Nov 15 13:03:06 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55506c0670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ad48d7-c272-4e46-ac6f-08158833b297]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[871313fa-16c1-4cf3-90a1-77ab6097a2d5]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2ae80f-9f85-4e9b-b936-5c15b2fe9af9]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f388cd1f-3e66-45d9-bda3-7bad098fa101]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4f903f-8c17-46ad-90d0-b159bc97e237]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c496c0a-8f3f-4dfa-8456-888e507a1579]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260]
Nov 15 13:03:06 user nova-compute[75813]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a, portal: 172.16.0.220,3260] successful.
Nov 15 13:03:06 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa28342-d5e4-49c5-9366-b3debd9a522a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bc5721-7812-4380-9efc-cc26d8d4bba6]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] <== disconnect_volume: return (350ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:03:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:07 user nova-compute[75813]: DEBUG nova.objects.instance [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1b40f196-8109-4d13-9332-cf68de9cb080 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.736s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a08e82de-ed36-464f-840f-695dd6f3d2d6 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a08e82de-ed36-464f-840f-695dd6f3d2d6 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a08e82de-ed36-464f-840f-695dd6f3d2d6 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a08e82de-ed36-464f-840f-695dd6f3d2d6 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75813) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a08e82de-ed36-464f-840f-695dd6f3d2d6 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-51c90f94-85e2-455d-8d98-c7998be0ba44 req-8c735f02-003e-47ab-baf5-7ccc65652f2d service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-unplugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-51c90f94-85e2-455d-8d98-c7998be0ba44 req-8c735f02-003e-47ab-baf5-7ccc65652f2d service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-51c90f94-85e2-455d-8d98-c7998be0ba44 req-8c735f02-003e-47ab-baf5-7ccc65652f2d service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-51c90f94-85e2-455d-8d98-c7998be0ba44 req-8c735f02-003e-47ab-baf5-7ccc65652f2d service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-51c90f94-85e2-455d-8d98-c7998be0ba44 req-8c735f02-003e-47ab-baf5-7ccc65652f2d service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-unplugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:08 user nova-compute[75813]: WARNING nova.compute.manager [req-51c90f94-85e2-455d-8d98-c7998be0ba44 req-8c735f02-003e-47ab-baf5-7ccc65652f2d service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received unexpected event network-vif-unplugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with vm_state active and task_state powering-off.
Nov 15 13:03:08 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance destroyed successfully.
Nov 15 13:03:08 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a08e82de-ed36-464f-840f-695dd6f3d2d6 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:03:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a08e82de-ed36-464f-840f-695dd6f3d2d6 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.825s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-7778c185-82ea-4b7e-bf0c-13342d40ba55 req-c5091ca4-24ef-4fb8-8735-3d389f1fcece service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7778c185-82ea-4b7e-bf0c-13342d40ba55 req-c5091ca4-24ef-4fb8-8735-3d389f1fcece service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7778c185-82ea-4b7e-bf0c-13342d40ba55 req-c5091ca4-24ef-4fb8-8735-3d389f1fcece service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7778c185-82ea-4b7e-bf0c-13342d40ba55 req-c5091ca4-24ef-4fb8-8735-3d389f1fcece service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-7778c185-82ea-4b7e-bf0c-13342d40ba55 req-c5091ca4-24ef-4fb8-8735-3d389f1fcece service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:10 user nova-compute[75813]: WARNING nova.compute.manager [req-7778c185-82ea-4b7e-bf0c-13342d40ba55 req-c5091ca4-24ef-4fb8-8735-3d389f1fcece service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received unexpected event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with vm_state stopped and task_state None.
Nov 15 13:03:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG nova.objects.instance [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'flavor' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:15 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 933c225a-9ff5-406b-9600-6a90e738810c is timed out.
Nov 15 13:03:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Successfully detached device vdc from instance 933c225a-9ff5-406b-9600-6a90e738810c from the live domain config.
Nov 15 13:03:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFvSAHwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:15 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:03:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b993dcfa-27c7-4f53-9128-c5fd936f4104]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:03:15 user nova-compute[75813]: No targets found.
Nov 15 13:03:15 user nova-compute[75813]: iSNS:
Nov 15 13:03:15 user nova-compute[75813]: No targets found.
Nov 15 13:03:15 user nova-compute[75813]: STATIC:
Nov 15 13:03:15 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:03:15 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:03:15 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:03:15 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a
Nov 15 13:03:15 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:03:15 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:03:15 user nova-compute[75813]: FIRMWARE:
Nov 15 13:03:15 user nova-compute[75813]: No targets found.
Nov 15 13:03:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:03:15 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:03:15 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:03:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e7ac6e-748a-403c-8b58-a79d27ea7889]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:16 user nova-compute[75813]: INFO nova.compute.manager [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Attaching volume ee5f4840-0070-4498-bdae-b118ca081e5a to /dev/vdb
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[085a0742-90a4-48f7-b7a4-d39fd8bbde90]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:16 user nova-compute[75813]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)
Nov 15 13:03:16 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:16 user nova-compute[75813]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a (non-flash)
Nov 15 13:03:16 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55506c37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a'): ({'sde'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Removing single pathed devices sde {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[738fd08e-6783-4650-a053-335073942a99]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.utils [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a62cced-46aa-4898-861f-e704f4229cd5]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Flushing IO for device /dev/sde {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[33af1816-5b71-4a07-af0a-9e7084fd90a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c22f1d3-9e84-40fe-9850-80e963fb64a3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.045s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca4ddfc-c040-418b-8071-4f1ea8351751]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e39cb9-c59b-4cb5-82e0-994cd6c8f4f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f219922c-67fc-4a10-a41c-f6187da6325d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ebba12-2c73-4d19-ac93-4a7ff448c211]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:03:16 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f33603-279d-4755-ab02-1fbf8cd861d5]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.utils [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updating existing volume attachment record: fde15fb3-3f5f-48cb-9d33-b8a3ac30e15f {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[170b62e0-1ce3-4120-a484-b1247beef30c]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ccdfb7-02ae-4f57-b9b1-a88c1095bfcc]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a, portal: 172.16.0.220,3260]
Nov 15 13:03:16 user nova-compute[75813]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a, portal: 172.16.0.220,3260] successful.
Nov 15 13:03:16 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923cad8c-3442-475d-97b0-f67a8bd7b40a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[42275767-f822-4dfc-97cb-f597735a6cc6]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] <== disconnect_volume: return (354ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:03:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:17 user nova-compute[75813]: DEBUG nova.objects.instance [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'flavor' on Instance uuid 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e7750f90-9c80-4dae-8527-987219ebd0d3 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.684s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LzkjYOtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:20 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:20 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:20 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90f8d39-5d4f-4740-b7b1-06450c2d6718]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:03:20 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4af6f44-17c2-4074-80d1-f92759062de6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a] added
Nov 15 13:03:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff748541-e7be-43ed-980f-e7a238bb695e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4ba8c5-c80e-47e2-9a5a-8fa31297326b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LzkjYOtB {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LzkjYOtB" returned: 0 in 0.036s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bd1b35-b6d6-458a-8d5d-f7f71b4f6170]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LzkjYOtB'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4a20ad-b3d0-46fa-8736-0cb9a20e33a0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[31875ad1-5d1a-4656-8129-cb3cc8627064]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6179f6-82ad-4130-b605-15bbb461a1f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a, portal: 172.16.0.220,3260]
Nov 15 13:03:20 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a, portal: 172.16.0.220,3260] successful.
Nov 15 13:03:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a952b82-39ca-4a5d-a4b1-a35a4cea055f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[71840286-e4e4-4d73-8a09-a909189170d1]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:21 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:21 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfedfdb7-5554-43c6-a667-7a0e92e1c54e]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:03:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LzkjYOtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26362653930636264', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362653930636264', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG nova.objects.instance [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'flavor' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:03:22 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:03:22 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:03:22 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:03:22 user nova-compute[75813]:   <serial>ee5f4840-0070-4498-bdae-b118ca081e5a</serial>
Nov 15 13:03:22 user nova-compute[75813]: </disk>
Nov 15 13:03:22 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] No VIF found with MAC fa:16:3e:51:f9:c7, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-273846be-b2ea-4f11-8780-78daa5f0efcf tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.602s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:23 user nova-compute[75813]: INFO nova.compute.manager [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Rescuing
Nov 15 13:03:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:03:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquired lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:03:23 user nova-compute[75813]: DEBUG nova.network.neutron [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:03:24 user nova-compute[75813]: DEBUG nova.network.neutron [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updating instance_info_cache with network_info: [{"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:03:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Releasing lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:03:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-c2752fd9-9c3a-4a83-8835-333e7da6add1 req-b6e0b706-f20a-4dd4-b012-ab5dc66e9565 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-unplugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2752fd9-9c3a-4a83-8835-333e7da6add1 req-b6e0b706-f20a-4dd4-b012-ab5dc66e9565 service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2752fd9-9c3a-4a83-8835-333e7da6add1 req-b6e0b706-f20a-4dd4-b012-ab5dc66e9565 service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c2752fd9-9c3a-4a83-8835-333e7da6add1 req-b6e0b706-f20a-4dd4-b012-ab5dc66e9565 service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-c2752fd9-9c3a-4a83-8835-333e7da6add1 req-b6e0b706-f20a-4dd4-b012-ab5dc66e9565 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-unplugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:24 user nova-compute[75813]: WARNING nova.compute.manager [req-c2752fd9-9c3a-4a83-8835-333e7da6add1 req-b6e0b706-f20a-4dd4-b012-ab5dc66e9565 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received unexpected event network-vif-unplugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with vm_state active and task_state rescuing.
Nov 15 13:03:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Instance destroyed successfully.
Nov 15 13:03:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Attempting a stable device rescue
Nov 15 13:03:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75813) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 13:03:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Instance directory exists: not creating {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 13:03:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Creating image(s)
Nov 15 13:03:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "/opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "/opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:25 user nova-compute[75813]: DEBUG nova.objects.instance [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "45ac12f00469f059f9da69fdad2bbd6f97c6117e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "45ac12f00469f059f9da69fdad2bbd6f97c6117e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e.part --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e.part --force-share --output=json" returned: 0 in 0.193s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:26 user nova-compute[75813]: DEBUG nova.virt.images [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] c2fa6b64-edb0-4d22-a542-02923e07d6b4 was qcow2, converting to raw {{(pid=75813) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 13:03:26 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:03:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e.part /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e.converted {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-1d48a9be-e336-4202-a402-bba3c682cf8e req-72364a78-e4ce-4a0b-bdb3-ea5ee20b2d8c service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1d48a9be-e336-4202-a402-bba3c682cf8e req-72364a78-e4ce-4a0b-bdb3-ea5ee20b2d8c service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1d48a9be-e336-4202-a402-bba3c682cf8e req-72364a78-e4ce-4a0b-bdb3-ea5ee20b2d8c service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1d48a9be-e336-4202-a402-bba3c682cf8e req-72364a78-e4ce-4a0b-bdb3-ea5ee20b2d8c service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-1d48a9be-e336-4202-a402-bba3c682cf8e req-72364a78-e4ce-4a0b-bdb3-ea5ee20b2d8c service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:26 user nova-compute[75813]: WARNING nova.compute.manager [req-1d48a9be-e336-4202-a402-bba3c682cf8e req-72364a78-e4ce-4a0b-bdb3-ea5ee20b2d8c service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received unexpected event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with vm_state active and task_state rescuing.
Nov 15 13:03:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e.part /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e.converted" returned: 0 in 0.506s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e.converted --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "45ac12f00469f059f9da69fdad2bbd6f97c6117e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.863s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "45ac12f00469f059f9da69fdad2bbd6f97c6117e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "45ac12f00469f059f9da69fdad2bbd6f97c6117e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e,backing_fmt=raw /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.rescue {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e,backing_fmt=raw /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.rescue" returned: 0 in 0.048s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "45ac12f00469f059f9da69fdad2bbd6f97c6117e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.objects.instance [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'migration_context' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.objects.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Object Instance<9fed6377-0614-41ae-b421-75d74da5fa4f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Start _get_guest_xml network_info=[{"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "vif_mac": "fa:16:3e:51:f9:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c2fa6b64-edb0-4d22-a542-02923e07d6b4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': 'fde15fb3-3f5f-48cb-9d33-b8a3ac30e15f', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LzkjYOtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9fed6377-0614-41ae-b421-75d74da5fa4f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee5f4840-0070-4498-bdae-b118ca081e5a', 'serial': 'ee5f4840-0070-4498-bdae-b118ca081e5a'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.objects.instance [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'resources' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.objects.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Object Instance<9fed6377-0614-41ae-b421-75d74da5fa4f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.objects.instance [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'numa_topology' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.objects.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Object Instance<9fed6377-0614-41ae-b421-75d74da5fa4f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:03:27 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:03:27 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.objects.instance [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.objects.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Object Instance<9fed6377-0614-41ae-b421-75d74da5fa4f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LzkjYOtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:27 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:27 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:27 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a8ce77-b695-4e97-8ae1-58e1ef58e2cc]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LzkjYOtB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 13:03:27 user nova-compute[75813]: node.name = iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a
Nov 15 13:03:27 user nova-compute[75813]: node.tpgt = -1
Nov 15 13:03:27 user nova-compute[75813]: node.startup = automatic
Nov 15 13:03:27 user nova-compute[75813]: node.leading_login = No
Nov 15 13:03:27 user nova-compute[75813]: iface.iscsi_ifacename = default
Nov 15 13:03:27 user nova-compute[75813]: iface.net_ifacename = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.ipaddress = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.prefix_len = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.hwaddress = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.transport_name = tcp
Nov 15 13:03:27 user nova-compute[75813]: iface.initiatorname = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.state = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.vlan_id = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.vlan_priority = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.vlan_state = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.iface_num = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.mtu = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.port = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.bootproto = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.subnet_mask = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.gateway = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.dhcp_alt_client_id = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.dhcp_dns = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.dhcp_learn_iqn = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.dhcp_vendor_id_state = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.dhcp_vendor_id = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.dhcp_slp_da = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.fragmentation = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.gratuitous_arp = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.incoming_forwarding = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.tos_state = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.tos = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.ttl = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.delayed_ack = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.tcp_nagle = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.tcp_wsf_state = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.tcp_wsf = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.tcp_timer_scale = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.tcp_timestamp = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.redirect = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.def_task_mgmt_timeout = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.header_digest = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.data_digest = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.immediate_data = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.initial_r2t = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.data_seq_inorder = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.data_pdu_inorder = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.erl = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.max_receive_data_len = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.first_burst_len = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.max_outstanding_r2t = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.max_burst_len = 0
Nov 15 13:03:27 user nova-compute[75813]: iface.chap_auth = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.bidi_chap = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.strict_login_compliance = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.discovery_auth = <empty>
Nov 15 13:03:27 user nova-compute[75813]: iface.discovery_logout = <empty>
Nov 15 13:03:27 user nova-compute[75813]: node.discovery_address = <empty>
Nov 15 13:03:27 user nova-compute[75813]: node.discovery_port = 0
Nov 15 13:03:27 user nova-compute[75813]: node.discovery_type = static
Nov 15 13:03:27 user nova-compute[75813]: node.session.initial_cmdsn = 0
Nov 15 13:03:27 user nova-compute[75813]: node.session.initial_login_retry_max = 8
Nov 15 13:03:27 user nova-compute[75813]: node.session.xmit_thread_priority = -20
Nov 15 13:03:27 user nova-compute[75813]: node.session.cmds_max = 128
Nov 15 13:03:27 user nova-compute[75813]: node.session.queue_depth = 32
Nov 15 13:03:27 user nova-compute[75813]: node.session.nr_sessions = 1
Nov 15 13:03:27 user nova-compute[75813]: node.session.auth.authmethod = CHAP
Nov 15 13:03:27 user nova-compute[75813]: node.session.auth.username = LzkjYOtB
Nov 15 13:03:27 user nova-compute[75813]: node.session.auth.password = ***
Nov 15 13:03:27 user nova-compute[75813]: node.session.auth.username_in = <empty>
Nov 15 13:03:27 user nova-compute[75813]: node.session.auth.password_in = <empty>
Nov 15 13:03:27 user nova-compute[75813]: node.session.auth.chap_algs = MD5
Nov 15 13:03:27 user nova-compute[75813]: node.session.timeo.replacement_timeout = 120
Nov 15 13:03:27 user nova-compute[75813]: node.session.err_timeo.abort_timeout = 15
Nov 15 13:03:27 user nova-compute[75813]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 13:03:27 user nova-compute[75813]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 13:03:27 user nova-compute[75813]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 13:03:27 user nova-compute[75813]: node.session.iscsi.FastAbort = Yes
Nov 15 13:03:27 user nova-compute[75813]: node.session.iscsi.InitialR2T = No
Nov 15 13:03:27 user nova-compute[75813]: node.session.iscsi.ImmediateData = Yes
Nov 15 13:03:27 user nova-compute[75813]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 13:03:27 user nova-compute[75813]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 13:03:27 user nova-compute[75813]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 13:03:27 user nova-compute[75813]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 13:03:27 user nova-compute[75813]: node.session.iscsi.MaxConnections = 1
Nov 15 13:03:27 user nova-compute[75813]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 13:03:27 user nova-compute[75813]: node.session.iscsi.ERL = 0
Nov 15 13:03:27 user nova-compute[75813]: node.session.scan = manual
Nov 15 13:03:27 user nova-compute[75813]: node.session.reopen_max = 0
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].address = 172.16.0.220
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].port = 3260
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].startup = manual
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].tcp.window_size = 524288
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].tcp.type_of_service = 0
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].timeo.logout_timeout = 15
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].timeo.login_timeout = 15
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].timeo.auth_timeout = 45
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].iscsi.DataDigest = None
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].iscsi.IFMarker = No
Nov 15 13:03:27 user nova-compute[75813]: node.conn[0].iscsi.OFMarker = No
Nov 15 13:03:27 user nova-compute[75813]: # END RECORD
Nov 15 13:03:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dc7f56-422a-4547-a64b-7a45264e3989]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e84655-bf78-43c2-b2ec-e4b6bd15694e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LzkjYOtB {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LzkjYOtB" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[095b43be-fed3-44be-8a5a-a2921ce5642b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LzkjYOtB'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d51e85-df82-4071-ae2a-e275f90c4ec2]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0e4fe8-7a18-4b9c-908c-cc73d55aa919]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:27 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:27 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.137s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] HCTL ('33', '0', '0', 0) found on session 37 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4fcb30-87d8-437b-a1df-f2365447e691]: (4, ('0 0 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Searching for a device in session 37 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LzkjYOtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.161s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] <== connect_volume: return (163ms) {'type': 'block', 'scsi_wwn': '26362653930636264', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362653930636264', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-769032625',display_name='tempest-ServerStableDeviceRescueTest-server-769032625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-769032625',id=26,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzzk9jkYa2qK3g2qHA80X2IIlCEvYNVQHBu3MXjtij+IveyI/kQM+mfPmI4bzYJMNgOrabk3d96/29iEiC5VLn8uVpUX8YHFyrCAmQw348M8B4eJlyJR5go7pI8xa1dXA==',key_name='tempest-keypair-1027890915',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:59:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64457e74254e47b6845be2aef4de8206',ramdisk_id='',reservation_id='r-ae33rltr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-344856713',owner_user_name='tempest-ServerStableDeviceRescueTest-344856713-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63700cf0bb0044a59c71f38fe702e812',uuid=9fed6377-0614-41ae-b421-75d74da5fa4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "vif_mac": "fa:16:3e:51:f9:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Converting VIF {"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "vif_mac": "fa:16:3e:51:f9:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:f9:c7,bridge_name='br-int',has_traffic_filtering=True,id=0855cbc5-0088-42fb-be12-422784a52b93,network=Network(87e7af6f-5cca-4d1f-8c4d-8763e71bfa17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0855cbc5-00') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.objects.instance [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.objects.base [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Object Instance<9fed6377-0614-41ae-b421-75d74da5fa4f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:03:27 user nova-compute[75813]:   <uuid>9fed6377-0614-41ae-b421-75d74da5fa4f</uuid>
Nov 15 13:03:27 user nova-compute[75813]:   <name>instance-0000001a</name>
Nov 15 13:03:27 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:03:27 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:03:27 user nova-compute[75813]:   <metadata>
Nov 15 13:03:27 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:03:27 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:03:27 user nova-compute[75813]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-769032625</nova:name>
Nov 15 13:03:27 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:03:27</nova:creationTime>
Nov 15 13:03:27 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:03:27 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:03:27 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:03:27 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:03:27 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:03:27 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:03:27 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:03:27 user nova-compute[75813]:       <nova:owner>
Nov 15 13:03:27 user nova-compute[75813]:         <nova:user uuid="63700cf0bb0044a59c71f38fe702e812">tempest-ServerStableDeviceRescueTest-344856713-project-member</nova:user>
Nov 15 13:03:27 user nova-compute[75813]:         <nova:project uuid="64457e74254e47b6845be2aef4de8206">tempest-ServerStableDeviceRescueTest-344856713</nova:project>
Nov 15 13:03:27 user nova-compute[75813]:       </nova:owner>
Nov 15 13:03:27 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:03:27 user nova-compute[75813]:       <nova:ports>
Nov 15 13:03:27 user nova-compute[75813]:         <nova:port uuid="0855cbc5-0088-42fb-be12-422784a52b93">
Nov 15 13:03:27 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 13:03:27 user nova-compute[75813]:         </nova:port>
Nov 15 13:03:27 user nova-compute[75813]:       </nova:ports>
Nov 15 13:03:27 user nova-compute[75813]:     </nova:instance>
Nov 15 13:03:27 user nova-compute[75813]:   </metadata>
Nov 15 13:03:27 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:03:27 user nova-compute[75813]:     <system>
Nov 15 13:03:27 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:03:27 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:03:27 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:03:27 user nova-compute[75813]:       <entry name="serial">9fed6377-0614-41ae-b421-75d74da5fa4f</entry>
Nov 15 13:03:27 user nova-compute[75813]:       <entry name="uuid">9fed6377-0614-41ae-b421-75d74da5fa4f</entry>
Nov 15 13:03:27 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:03:27 user nova-compute[75813]:     </system>
Nov 15 13:03:27 user nova-compute[75813]:   </sysinfo>
Nov 15 13:03:27 user nova-compute[75813]:   <os>
Nov 15 13:03:27 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:03:27 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:03:27 user nova-compute[75813]:   </os>
Nov 15 13:03:27 user nova-compute[75813]:   <features>
Nov 15 13:03:27 user nova-compute[75813]:     <acpi/>
Nov 15 13:03:27 user nova-compute[75813]:     <apic/>
Nov 15 13:03:27 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:03:27 user nova-compute[75813]:   </features>
Nov 15 13:03:27 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:03:27 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:03:27 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:03:27 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:03:27 user nova-compute[75813]:   </clock>
Nov 15 13:03:27 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:03:27 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:03:27 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:03:27 user nova-compute[75813]:   </cpu>
Nov 15 13:03:27 user nova-compute[75813]:   <devices>
Nov 15 13:03:27 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:03:27 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:03:27 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk"/>
Nov 15 13:03:27 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:03:27 user nova-compute[75813]:     </disk>
Nov 15 13:03:27 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:03:27 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:03:27 user nova-compute[75813]:       <source dev="/dev/sdb"/>
Nov 15 13:03:27 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 13:03:27 user nova-compute[75813]:       <serial>ee5f4840-0070-4498-bdae-b118ca081e5a</serial>
Nov 15 13:03:27 user nova-compute[75813]:     </disk>
Nov 15 13:03:27 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:03:27 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:03:27 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.rescue"/>
Nov 15 13:03:27 user nova-compute[75813]:       <target dev="vdc" bus="virtio"/>
Nov 15 13:03:27 user nova-compute[75813]:       <boot order="1"/>
Nov 15 13:03:27 user nova-compute[75813]:     </disk>
Nov 15 13:03:27 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:03:27 user nova-compute[75813]:       <mac address="fa:16:3e:51:f9:c7"/>
Nov 15 13:03:27 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:03:27 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:03:27 user nova-compute[75813]:       <target dev="tap0855cbc5-00"/>
Nov 15 13:03:27 user nova-compute[75813]:     </interface>
Nov 15 13:03:27 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:03:27 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/console.log" append="off"/>
Nov 15 13:03:27 user nova-compute[75813]:     </serial>
Nov 15 13:03:27 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:03:27 user nova-compute[75813]:     <video>
Nov 15 13:03:27 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:03:27 user nova-compute[75813]:     </video>
Nov 15 13:03:27 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:03:27 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:03:27 user nova-compute[75813]:     </rng>
Nov 15 13:03:27 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:03:27 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:03:27 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:03:27 user nova-compute[75813]:     </memballoon>
Nov 15 13:03:27 user nova-compute[75813]:   </devices>
Nov 15 13:03:27 user nova-compute[75813]: </domain>
Nov 15 13:03:27 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:03:27 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Instance destroyed successfully.
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:03:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] No VIF found with MAC fa:16:3e:51:f9:c7, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:03:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-7cbfbe41-0533-4111-849a-4525eb0a4948 req-0b419809-6157-4a5f-95a8-1c7285d0d18b service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7cbfbe41-0533-4111-849a-4525eb0a4948 req-0b419809-6157-4a5f-95a8-1c7285d0d18b service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7cbfbe41-0533-4111-849a-4525eb0a4948 req-0b419809-6157-4a5f-95a8-1c7285d0d18b service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7cbfbe41-0533-4111-849a-4525eb0a4948 req-0b419809-6157-4a5f-95a8-1c7285d0d18b service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-7cbfbe41-0533-4111-849a-4525eb0a4948 req-0b419809-6157-4a5f-95a8-1c7285d0d18b service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:29 user nova-compute[75813]: WARNING nova.compute.manager [req-7cbfbe41-0533-4111-849a-4525eb0a4948 req-0b419809-6157-4a5f-95a8-1c7285d0d18b service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received unexpected event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with vm_state active and task_state rescuing.
Nov 15 13:03:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-95894502-5f38-4f51-a564-860fa7d0ba7f req-c78349c6-b4b7-4833-a5ec-7fc292fd4c8a service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-95894502-5f38-4f51-a564-860fa7d0ba7f req-c78349c6-b4b7-4833-a5ec-7fc292fd4c8a service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-95894502-5f38-4f51-a564-860fa7d0ba7f req-c78349c6-b4b7-4833-a5ec-7fc292fd4c8a service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-95894502-5f38-4f51-a564-860fa7d0ba7f req-c78349c6-b4b7-4833-a5ec-7fc292fd4c8a service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-95894502-5f38-4f51-a564-860fa7d0ba7f req-c78349c6-b4b7-4833-a5ec-7fc292fd4c8a service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:31 user nova-compute[75813]: WARNING nova.compute.manager [req-95894502-5f38-4f51-a564-860fa7d0ba7f req-c78349c6-b4b7-4833-a5ec-7fc292fd4c8a service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received unexpected event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with vm_state active and task_state rescuing.
Nov 15 13:03:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-243ab152-cb8c-469a-b955-2bbab243d4b2 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:03:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:33 user nova-compute[75813]: DEBUG nova.objects.instance [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'flavor' on Instance uuid 01c3ee8c-322c-42c6-8c33-22ae16e77c46 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-77afbf7b-e1ca-45e2-a9c2-aeb17f5641b3 req-69056aba-1dce-4429-bc0f-093873d32aa1 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-changed-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-77afbf7b-e1ca-45e2-a9c2-aeb17f5641b3 req-69056aba-1dce-4429-bc0f-093873d32aa1 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Refreshing instance network info cache due to event network-changed-51b054cd-cd32-4efa-9b1f-4b6257025c45. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:03:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77afbf7b-e1ca-45e2-a9c2-aeb17f5641b3 req-69056aba-1dce-4429-bc0f-093873d32aa1 service nova] Acquiring lock "refresh_cache-01c3ee8c-322c-42c6-8c33-22ae16e77c46" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:03:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77afbf7b-e1ca-45e2-a9c2-aeb17f5641b3 req-69056aba-1dce-4429-bc0f-093873d32aa1 service nova] Acquired lock "refresh_cache-01c3ee8c-322c-42c6-8c33-22ae16e77c46" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:03:33 user nova-compute[75813]: DEBUG nova.network.neutron [req-77afbf7b-e1ca-45e2-a9c2-aeb17f5641b3 req-69056aba-1dce-4429-bc0f-093873d32aa1 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Refreshing network info cache for port 51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:03:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:33 user nova-compute[75813]: INFO nova.compute.manager [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Attaching volume 2e70b809-480b-4c14-a446-538c1975eedd to /dev/vdb
Nov 15 13:03:34 user nova-compute[75813]: DEBUG os_brick.utils [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7573553c-e93d-497d-8804-d51b8fa1a637]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fcf62a-96c9-4397-9918-ed682a6f8510]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a82e0f-d567-4a16-8544-9e7b0b380924]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[37208da2-0e6d-46aa-a152-c6b4c8b68cbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:03:34 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2419bb29-24e1-4037-babf-bde4afbd690f]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG os_brick.utils [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Updating existing volume attachment record: 84834cea-8497-48fe-af7a-9230128888b7 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG nova.network.neutron [req-77afbf7b-e1ca-45e2-a9c2-aeb17f5641b3 req-69056aba-1dce-4429-bc0f-093873d32aa1 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Updated VIF entry in instance network info cache for port 51b054cd-cd32-4efa-9b1f-4b6257025c45. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG nova.network.neutron [req-77afbf7b-e1ca-45e2-a9c2-aeb17f5641b3 req-69056aba-1dce-4429-bc0f-093873d32aa1 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Updating instance_info_cache with network_info: [{"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:03:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77afbf7b-e1ca-45e2-a9c2-aeb17f5641b3 req-69056aba-1dce-4429-bc0f-093873d32aa1 service nova] Releasing lock "refresh_cache-01c3ee8c-322c-42c6-8c33-22ae16e77c46" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:03:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKOwYxZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:39 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:39 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:39 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0ff367-6f89-4bf4-83b2-4356716b0509]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:03:39 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4489a74-fa12-4be8-9199-91744bccc3bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd] added
Nov 15 13:03:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd1de3b-6fc0-4658-8c00-8a751f7bc59d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc44d78d-3c51-4229-a9e3-843b82e47e92]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKOwYxZB {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKOwYxZB" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3c43dc-adc2-49ca-9e8c-90116c693496]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SKOwYxZB'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[86de5c20-a355-49f6-ba9a-1d1af82e19ca]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2c2ef3-97ef-41a7-a770-167f6c1ee3a7]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:39 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:39 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a4e199-771e-4aa2-9b68-aa6158f41a7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260]
Nov 15 13:03:39 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260] successful.
Nov 15 13:03:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[56784c15-3c24-4dea-8a38-0be3b26e25de]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c100719-8ecc-42cc-8e5a-09cc25675a73]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:39 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:39 user nova-compute[75813]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:03:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:39 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:39 user nova-compute[75813]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:03:39 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3312f7a2-5b43-4491-89b7-c04d96f20b54]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKOwYxZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:03:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] There are 0 instances to clean {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23231393864646336', 'path': '/dev/sdd'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231393864646336', 'path': '/dev/sdd'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG nova.objects.instance [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'flavor' on Instance uuid 01c3ee8c-322c-42c6-8c33-22ae16e77c46 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:03:40 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:03:40 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 13:03:40 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:03:40 user nova-compute[75813]:   <serial>2e70b809-480b-4c14-a446-538c1975eedd</serial>
Nov 15 13:03:40 user nova-compute[75813]: </disk>
Nov 15 13:03:40 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No VIF found with MAC fa:16:3e:3c:4a:8e, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-26465b7d-4a6c-4e90-8b41-e4c93a39a38e tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.929s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:42 user nova-compute[75813]: INFO nova.compute.manager [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Rebuilding instance
Nov 15 13:03:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:03:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-a4abc326-dbdb-4784-b23e-fa533436838f req-41816314-a159-4cf8-b2f1-f2c462f47d55 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-vif-unplugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a4abc326-dbdb-4784-b23e-fa533436838f req-41816314-a159-4cf8-b2f1-f2c462f47d55 service nova] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a4abc326-dbdb-4784-b23e-fa533436838f req-41816314-a159-4cf8-b2f1-f2c462f47d55 service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a4abc326-dbdb-4784-b23e-fa533436838f req-41816314-a159-4cf8-b2f1-f2c462f47d55 service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-a4abc326-dbdb-4784-b23e-fa533436838f req-41816314-a159-4cf8-b2f1-f2c462f47d55 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] No waiting events found dispatching network-vif-unplugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:42 user nova-compute[75813]: WARNING nova.compute.manager [req-a4abc326-dbdb-4784-b23e-fa533436838f req-41816314-a159-4cf8-b2f1-f2c462f47d55 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received unexpected event network-vif-unplugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 for instance with vm_state active and task_state rebuilding.
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75813) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 13:03:43 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Instance destroyed successfully.
Nov 15 13:03:43 user nova-compute[75813]: INFO nova.compute.manager [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Detaching volume 2e70b809-480b-4c14-a446-538c1975eedd
Nov 15 13:03:43 user nova-compute[75813]: INFO nova.virt.block_device [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Attempting to driver detach volume 2e70b809-480b-4c14-a446-538c1975eedd from mountpoint /dev/vdb
Nov 15 13:03:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Attempting to detach device vdb from instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:03:43 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:03:43 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 13:03:43 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:03:43 user nova-compute[75813]:   <serial>2e70b809-480b-4c14-a446-538c1975eedd</serial>
Nov 15 13:03:43 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:03:43 user nova-compute[75813]: </disk>
Nov 15 13:03:43 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:03:43 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully detached device vdb from instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 from the persistent domain config.
Nov 15 13:03:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKOwYxZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:43 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c30d0b5-d2d2-41ff-8bcc-22fca40e8923]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:03:43 user nova-compute[75813]: No targets found.
Nov 15 13:03:43 user nova-compute[75813]: iSNS:
Nov 15 13:03:43 user nova-compute[75813]: No targets found.
Nov 15 13:03:43 user nova-compute[75813]: STATIC:
Nov 15 13:03:43 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:03:43 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:03:43 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:03:43 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd
Nov 15 13:03:43 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:03:43 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:03:43 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a
Nov 15 13:03:43 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:03:43 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:03:43 user nova-compute[75813]: FIRMWARE:
Nov 15 13:03:43 user nova-compute[75813]: No targets found.
Nov 15 13:03:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:03:43 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:03:43 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f1c39a-48f3-4181-98a0-904d583508cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6e280d-b50f-45ff-89a9-363f7d5d7a15]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:43 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:43 user nova-compute[75813]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:03:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:43 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:43 user nova-compute[75813]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:03:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55307664d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd'): ({'sdd'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Removing single pathed devices sdd {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8d605f-3608-49e3-af69-eef1f82fd950]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f7792a-f2fb-439e-b526-c258cf7d2e5c]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flushing IO for device /dev/sdd {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c081dbc2-0d2f-49c8-b7a6-9c9af3a7726a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e965f61-1e3c-406e-b4d4-05661a874c65]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1667324b-e41f-41be-8e51-2bb1a2d6abdd]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[415eacd2-d6c6-46f5-9f84-46582101c968]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260]
Nov 15 13:03:43 user nova-compute[75813]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260] successful.
Nov 15 13:03:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6363b2b-c7de-4444-895c-d442cd441a5b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== disconnect_volume: return (283ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:03:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Instance destroyed successfully.
Nov 15 13:03:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-347681257',display_name='tempest-ServerActionsTestOtherA-server-1592404365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-347681257',id=28,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWQ0qmhy85GCBxBGKQ9gZY2Ij6XIXZ3e/Cefm0CoRTimt6Q7nvDlRwdtiaKTZS3e9QvWhzJJ7QwsM+NlsX4ZLpkyPKST4L/BpcsrIqva0sn5bllqIOgT8Pqn7YOrF5QTw==',key_name='tempest-keypair-1734348321',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:01:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-m5s0icbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=01c3ee8c-322c-42c6-8c33-22ae16e77c46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_vif [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51b054cd-cd, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e5d9989-9340-4377-b7cb-12bae30e730f) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:44 user nova-compute[75813]: INFO os_vif [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd')
Nov 15 13:03:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKOwYxZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:44 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30be604-0b97-4422-80cc-544723676f91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:03:44 user nova-compute[75813]: No targets found.
Nov 15 13:03:44 user nova-compute[75813]: iSNS:
Nov 15 13:03:44 user nova-compute[75813]: No targets found.
Nov 15 13:03:44 user nova-compute[75813]: STATIC:
Nov 15 13:03:44 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:03:44 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:03:44 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:03:44 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a
Nov 15 13:03:44 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:03:44 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:03:44 user nova-compute[75813]: FIRMWARE:
Nov 15 13:03:44 user nova-compute[75813]: No targets found.
Nov 15 13:03:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:03:44 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:03:44 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ccc3bb-cac5-44f9-8cdd-5f571027845b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6962f5b8-6f38-4401-92aa-58cfb0d8d6a4]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:44 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:44 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5530767760>, {}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Disconnecting from: [] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== disconnect_volume: return (68ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:03:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Deleting instance files /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46_del
Nov 15 13:03:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Deletion of /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46_del complete
Nov 15 13:03:45 user nova-compute[75813]: INFO nova.virt.block_device [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Booting with volume 2e70b809-480b-4c14-a446-538c1975eedd at /dev/vdb
Nov 15 13:03:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-3fc0454c-72c8-4626-bf1a-573cfbe95644 req-95d8eb1f-b180-46f5-99bd-f36fcb97ffac service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3fc0454c-72c8-4626-bf1a-573cfbe95644 req-95d8eb1f-b180-46f5-99bd-f36fcb97ffac service nova] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3fc0454c-72c8-4626-bf1a-573cfbe95644 req-95d8eb1f-b180-46f5-99bd-f36fcb97ffac service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3fc0454c-72c8-4626-bf1a-573cfbe95644 req-95d8eb1f-b180-46f5-99bd-f36fcb97ffac service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-3fc0454c-72c8-4626-bf1a-573cfbe95644 req-95d8eb1f-b180-46f5-99bd-f36fcb97ffac service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] No waiting events found dispatching network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:45 user nova-compute[75813]: WARNING nova.compute.manager [req-3fc0454c-72c8-4626-bf1a-573cfbe95644 req-95d8eb1f-b180-46f5-99bd-f36fcb97ffac service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received unexpected event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 15 13:03:45 user nova-compute[75813]: DEBUG os_brick.utils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[897cca09-24ea-40ed-a098-0b05f5b7b523]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9ad687-0c78-4eef-8ab3-82a0c6568218]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8438bb0b-9ee1-43a4-a706-d5a945610e38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[976581cf-9ec5-4b5d-8b4a-7cf11e55ef07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:03:45 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a2b8cd-b4ad-45c2-a0de-2fab9916d031]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG os_brick.utils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Updating existing volume attachment record: 5b09d58e-93b6-4245-a9e5-dd9d9b8d5e66 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:45 user nova-compute[75813]: INFO nova.compute.manager [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Terminating instance
Nov 15 13:03:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-75be5392-0b1a-456e-a72e-3f2de471cd5a req-b8fd535a-9421-49e9-a63e-97518d867fe4 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-vif-unplugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-75be5392-0b1a-456e-a72e-3f2de471cd5a req-b8fd535a-9421-49e9-a63e-97518d867fe4 service nova] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-75be5392-0b1a-456e-a72e-3f2de471cd5a req-b8fd535a-9421-49e9-a63e-97518d867fe4 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-75be5392-0b1a-456e-a72e-3f2de471cd5a req-b8fd535a-9421-49e9-a63e-97518d867fe4 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-75be5392-0b1a-456e-a72e-3f2de471cd5a req-b8fd535a-9421-49e9-a63e-97518d867fe4 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] No waiting events found dispatching network-vif-unplugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-75be5392-0b1a-456e-a72e-3f2de471cd5a req-b8fd535a-9421-49e9-a63e-97518d867fe4 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-vif-unplugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:46 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Instance destroyed successfully.
Nov 15 13:03:46 user nova-compute[75813]: DEBUG nova.objects.instance [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'resources' on Instance uuid 933c225a-9ff5-406b-9600-6a90e738810c {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T12:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-850952693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-850952693',id=22,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqVs2iLbmwX7/vowP0VC4cDfMVoE7o+iBjs+PlvP8I1SdBilZWyP/O6U7deeJL9IG22ogmYjkpNi1UI64FWTxrk4u73gBCVAkow6+DTajJvUW/fQXviHhni4tmqSXqWoA==',key_name='tempest-keypair-1330676257',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:01:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-kdv40ajl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:01:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=933c225a-9ff5-406b-9600-6a90e738810c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "address": "fa:16:3e:25:19:36", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38d4cbb-33", "ovs_interfaceid": "d38d4cbb-3312-4630-a9e2-27a4dadec958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG os_vif [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd38d4cbb-33, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2282a0e8-6495-4075-b91a-23aae7950b1a) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:46 user nova-compute[75813]: INFO os_vif [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:19:36,bridge_name='br-int',has_traffic_filtering=True,id=d38d4cbb-3312-4630-a9e2-27a4dadec958,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38d4cbb-33')
Nov 15 13:03:46 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Deleting instance files /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c_del
Nov 15 13:03:46 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Deletion of /opt/stack/data/nova/instances/933c225a-9ff5-406b-9600-6a90e738810c_del complete
Nov 15 13:03:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "4210006e-5842-432d-99ba-3849899c9713" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "4210006e-5842-432d-99ba-3849899c9713" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:46 user nova-compute[75813]: INFO nova.compute.manager [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 13:03:46 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:03:46 user nova-compute[75813]: INFO nova.compute.claims [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Claim successful on node user
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:03:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.policy [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bc41f21cddc40e7a287b6f809233a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63086918b1c84a608c4a5aebf968eab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:03:47 user nova-compute[75813]: INFO nova.virt.block_device [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Booting with volume snapshot 9aa88b50-6281-49a9-9347-2c6c57771519 at /dev/vda
Nov 15 13:03:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:03:47 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Took 0.90 seconds to deallocate network for instance.
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-9040c8dc-cc0a-4767-a324-39475759756b req-16736ce0-7442-4b7e-9cd2-0b03bb00989d service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-vif-deleted-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Refreshing inventories for resource provider 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Updating ProviderTree inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Refreshing aggregate associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, aggregates: None {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Refreshing trait associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, traits: HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updating instance_info_cache with network_info: [{"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Successfully created port: 108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:03:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:48 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Deleted allocations for instance 933c225a-9ff5-406b-9600-6a90e738810c
Nov 15 13:03:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-a8d21407-532b-42cd-be55-84e431add45b req-a9203cd8-26b2-4de6-bd25-9ecefcf64028 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8d21407-532b-42cd-be55-84e431add45b req-a9203cd8-26b2-4de6-bd25-9ecefcf64028 service nova] Acquiring lock "933c225a-9ff5-406b-9600-6a90e738810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8d21407-532b-42cd-be55-84e431add45b req-a9203cd8-26b2-4de6-bd25-9ecefcf64028 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8d21407-532b-42cd-be55-84e431add45b req-a9203cd8-26b2-4de6-bd25-9ecefcf64028 service nova] Lock "933c225a-9ff5-406b-9600-6a90e738810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-a8d21407-532b-42cd-be55-84e431add45b req-a9203cd8-26b2-4de6-bd25-9ecefcf64028 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] No waiting events found dispatching network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:48 user nova-compute[75813]: WARNING nova.compute.manager [req-a8d21407-532b-42cd-be55-84e431add45b req-a9203cd8-26b2-4de6-bd25-9ecefcf64028 service nova] [instance: 933c225a-9ff5-406b-9600-6a90e738810c] Received unexpected event network-vif-plugged-d38d4cbb-3312-4630-a9e2-27a4dadec958 for instance with vm_state deleted and task_state None.
Nov 15 13:03:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4821c027-7ee9-459f-8a52-faad86f1e7d1 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "933c225a-9ff5-406b-9600-6a90e738810c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.436s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Successfully updated port: 108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "refresh_cache-4210006e-5842-432d-99ba-3849899c9713" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquired lock "refresh_cache-4210006e-5842-432d-99ba-3849899c9713" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-7eb17704-6876-4137-84b0-d650eafeb80a req-0242c760-519d-4193-8256-dca678d677df service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Received event network-changed-108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-7eb17704-6876-4137-84b0-d650eafeb80a req-0242c760-519d-4193-8256-dca678d677df service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Refreshing instance network info cache due to event network-changed-108ec246-893b-4e48-abb2-2c71032180e3. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7eb17704-6876-4137-84b0-d650eafeb80a req-0242c760-519d-4193-8256-dca678d677df service nova] Acquiring lock "refresh_cache-4210006e-5842-432d-99ba-3849899c9713" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG nova.network.neutron [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Updating instance_info_cache with network_info: [{"id": "108ec246-893b-4e48-abb2-2c71032180e3", "address": "fa:16:3e:c4:47:83", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ec246-89", "ovs_interfaceid": "108ec246-893b-4e48-abb2-2c71032180e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Releasing lock "refresh_cache-4210006e-5842-432d-99ba-3849899c9713" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Instance network_info: |[{"id": "108ec246-893b-4e48-abb2-2c71032180e3", "address": "fa:16:3e:c4:47:83", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ec246-89", "ovs_interfaceid": "108ec246-893b-4e48-abb2-2c71032180e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7eb17704-6876-4137-84b0-d650eafeb80a req-0242c760-519d-4193-8256-dca678d677df service nova] Acquired lock "refresh_cache-4210006e-5842-432d-99ba-3849899c9713" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:03:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-7eb17704-6876-4137-84b0-d650eafeb80a req-0242c760-519d-4193-8256-dca678d677df service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Refreshing network info cache for port 108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:03:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:49 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:03:49 user nova-compute[75813]: DEBUG nova.network.neutron [req-7eb17704-6876-4137-84b0-d650eafeb80a req-0242c760-519d-4193-8256-dca678d677df service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Updated VIF entry in instance network info cache for port 108ec246-893b-4e48-abb2-2c71032180e3. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:03:49 user nova-compute[75813]: DEBUG nova.network.neutron [req-7eb17704-6876-4137-84b0-d650eafeb80a req-0242c760-519d-4193-8256-dca678d677df service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Updating instance_info_cache with network_info: [{"id": "108ec246-893b-4e48-abb2-2c71032180e3", "address": "fa:16:3e:c4:47:83", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ec246-89", "ovs_interfaceid": "108ec246-893b-4e48-abb2-2c71032180e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:03:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7eb17704-6876-4137-84b0-d650eafeb80a req-0242c760-519d-4193-8256-dca678d677df service nova] Releasing lock "refresh_cache-4210006e-5842-432d-99ba-3849899c9713" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:03:50 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:03:50 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Creating image(s)
Nov 15 13:03:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "/opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "/opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "/opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:50 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk 1073741824" returned: 0 in 0.048s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Cannot resize image /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Ensure instance console log exists: /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Start _get_guest_xml network_info=[{"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '5b09d58e-93b6-4245-a9e5-dd9d9b8d5e66', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKOwYxZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01c3ee8c-322c-42c6-8c33-22ae16e77c46', 'attached_at': '', 'detached_at': '', 'volume_id': '2e70b809-480b-4c14-a446-538c1975eedd', 'serial': '2e70b809-480b-4c14-a446-538c1975eedd'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:03:51 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 13:03:51 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.objects.instance [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01c3ee8c-322c-42c6-8c33-22ae16e77c46 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKOwYxZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:51 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:51 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:51 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddf971f-2fe1-4e48-831d-45c5acb38fa7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:03:51 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eb33d0-5a8d-4564-96f3-e7e34274d1b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd] added
Nov 15 13:03:51 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcbb02a-f987-47f2-9522-1787a738fde8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e59627-374f-4f6b-a4a4-e509f3246065]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKOwYxZB {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKOwYxZB" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9aeb3c-9750-4e77-af3f-60de116d07af]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SKOwYxZB'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e733ff57-84bd-4fcd-9bfc-5f7367d8aef1]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf6517e-b0be-4bf1-b6fb-29178bd468c2]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:51 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:51 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:51 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:51 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d297c10b-b419-4a9f-8bda-75701cad2ff6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260]
Nov 15 13:03:51 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260] successful.
Nov 15 13:03:51 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f5d253-0b6c-4794-94fd-4d33ea0cbfa1]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a6dd31-c4e6-4b69-a1d0-313df9b55e83]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:51 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:51 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:03:51 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:51 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:51 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:03:51 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d345cc0-dce4-4b3c-b6ae-2cec0ca1828e]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:03:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKOwYxZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23231393864646336', 'path': '/dev/sdd'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231393864646336', 'path': '/dev/sdd'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T13:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-347681257',display_name='tempest-ServerActionsTestOtherA-server-1592404365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-347681257',id=28,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWQ0qmhy85GCBxBGKQ9gZY2Ij6XIXZ3e/Cefm0CoRTimt6Q7nvDlRwdtiaKTZS3e9QvWhzJJ7QwsM+NlsX4ZLpkyPKST4L/BpcsrIqva0sn5bllqIOgT8Pqn7YOrF5QTw==',key_name='tempest-keypair-1734348321',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:01:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-m5s0icbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=01c3ee8c-322c-42c6-8c33-22ae16e77c46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:03:52 user nova-compute[75813]:   <uuid>01c3ee8c-322c-42c6-8c33-22ae16e77c46</uuid>
Nov 15 13:03:52 user nova-compute[75813]:   <name>instance-0000001c</name>
Nov 15 13:03:52 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:03:52 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:03:52 user nova-compute[75813]:   <metadata>
Nov 15 13:03:52 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:03:52 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:03:52 user nova-compute[75813]:       <nova:name>tempest-ServerActionsTestOtherA-server-1592404365</nova:name>
Nov 15 13:03:52 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:03:51</nova:creationTime>
Nov 15 13:03:52 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:03:52 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:03:52 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:03:52 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:03:52 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:03:52 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:03:52 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:03:52 user nova-compute[75813]:       <nova:owner>
Nov 15 13:03:52 user nova-compute[75813]:         <nova:user uuid="c2b3f74a69954ecf8d5cce188f5fc043">tempest-ServerActionsTestOtherA-1826218173-project-member</nova:user>
Nov 15 13:03:52 user nova-compute[75813]:         <nova:project uuid="76ae639fa3444ba0be3d480b8572a0e6">tempest-ServerActionsTestOtherA-1826218173</nova:project>
Nov 15 13:03:52 user nova-compute[75813]:       </nova:owner>
Nov 15 13:03:52 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:03:52 user nova-compute[75813]:       <nova:ports>
Nov 15 13:03:52 user nova-compute[75813]:         <nova:port uuid="51b054cd-cd32-4efa-9b1f-4b6257025c45">
Nov 15 13:03:52 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 13:03:52 user nova-compute[75813]:         </nova:port>
Nov 15 13:03:52 user nova-compute[75813]:       </nova:ports>
Nov 15 13:03:52 user nova-compute[75813]:     </nova:instance>
Nov 15 13:03:52 user nova-compute[75813]:   </metadata>
Nov 15 13:03:52 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:03:52 user nova-compute[75813]:     <system>
Nov 15 13:03:52 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:03:52 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:03:52 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:03:52 user nova-compute[75813]:       <entry name="serial">01c3ee8c-322c-42c6-8c33-22ae16e77c46</entry>
Nov 15 13:03:52 user nova-compute[75813]:       <entry name="uuid">01c3ee8c-322c-42c6-8c33-22ae16e77c46</entry>
Nov 15 13:03:52 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:03:52 user nova-compute[75813]:     </system>
Nov 15 13:03:52 user nova-compute[75813]:   </sysinfo>
Nov 15 13:03:52 user nova-compute[75813]:   <os>
Nov 15 13:03:52 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:03:52 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:03:52 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:03:52 user nova-compute[75813]:   </os>
Nov 15 13:03:52 user nova-compute[75813]:   <features>
Nov 15 13:03:52 user nova-compute[75813]:     <acpi/>
Nov 15 13:03:52 user nova-compute[75813]:     <apic/>
Nov 15 13:03:52 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:03:52 user nova-compute[75813]:   </features>
Nov 15 13:03:52 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:03:52 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:03:52 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:03:52 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:03:52 user nova-compute[75813]:   </clock>
Nov 15 13:03:52 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:03:52 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:03:52 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:03:52 user nova-compute[75813]:   </cpu>
Nov 15 13:03:52 user nova-compute[75813]:   <devices>
Nov 15 13:03:52 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:03:52 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:03:52 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk"/>
Nov 15 13:03:52 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:03:52 user nova-compute[75813]:     </disk>
Nov 15 13:03:52 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:03:52 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:03:52 user nova-compute[75813]:       <source dev="/dev/sdd"/>
Nov 15 13:03:52 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 13:03:52 user nova-compute[75813]:       <serial>2e70b809-480b-4c14-a446-538c1975eedd</serial>
Nov 15 13:03:52 user nova-compute[75813]:     </disk>
Nov 15 13:03:52 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:03:52 user nova-compute[75813]:       <mac address="fa:16:3e:3c:4a:8e"/>
Nov 15 13:03:52 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:03:52 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:03:52 user nova-compute[75813]:       <target dev="tap51b054cd-cd"/>
Nov 15 13:03:52 user nova-compute[75813]:     </interface>
Nov 15 13:03:52 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:03:52 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/console.log" append="off"/>
Nov 15 13:03:52 user nova-compute[75813]:     </serial>
Nov 15 13:03:52 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:03:52 user nova-compute[75813]:     <video>
Nov 15 13:03:52 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:03:52 user nova-compute[75813]:     </video>
Nov 15 13:03:52 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:03:52 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:03:52 user nova-compute[75813]:     </rng>
Nov 15 13:03:52 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:03:52 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:03:52 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:03:52 user nova-compute[75813]:     </memballoon>
Nov 15 13:03:52 user nova-compute[75813]:   </devices>
Nov 15 13:03:52 user nova-compute[75813]: </domain>
Nov 15 13:03:52 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T13:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-347681257',display_name='tempest-ServerActionsTestOtherA-server-1592404365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-347681257',id=28,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWQ0qmhy85GCBxBGKQ9gZY2Ij6XIXZ3e/Cefm0CoRTimt6Q7nvDlRwdtiaKTZS3e9QvWhzJJ7QwsM+NlsX4ZLpkyPKST4L/BpcsrIqva0sn5bllqIOgT8Pqn7YOrF5QTw==',key_name='tempest-keypair-1734348321',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:01:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-m5s0icbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=01c3ee8c-322c-42c6-8c33-22ae16e77c46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG os_vif [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f28d381d-67fa-501b-947d-18d2b3e05f63', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51b054cd-cd, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51b054cd-cd, col_values=(('qos', UUID('66358e9b-bc7f-40db-bf85-21c0c113c3cd')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51b054cd-cd, col_values=(('external_ids', {'iface-id': '51b054cd-cd32-4efa-9b1f-4b6257025c45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:4a:8e', 'vm-uuid': '01c3ee8c-322c-42c6-8c33-22ae16e77c46'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:03:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:52 user nova-compute[75813]: INFO os_vif [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd')
Nov 15 13:03:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No VIF found with MAC fa:16:3e:3c:4a:8e, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG os_brick.utils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d40e6d3-8ae9-4349-b153-e6e498235c0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63e1fc5-a98e-4997-a376-d5d7b6ae8aa5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c53f046-900b-47dd-97b7-bbe0e3a3a845]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c4c026-d014-4ddc-b766-ce9733dae4be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:03:53 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:03:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47957d4-55fa-49b9-835c-8b0491a003c6]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG os_brick.utils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:53 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Updating existing volume attachment record: 3294cbbd-435f-4d67-9d13-f178da3fdfc0 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:03:54 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-7d9b2607-9215-455b-8994-da8e00512ac4 req-728954db-9df3-4172-a4ee-a6b76b26c88b service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7d9b2607-9215-455b-8994-da8e00512ac4 req-728954db-9df3-4172-a4ee-a6b76b26c88b service nova] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7d9b2607-9215-455b-8994-da8e00512ac4 req-728954db-9df3-4172-a4ee-a6b76b26c88b service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7d9b2607-9215-455b-8994-da8e00512ac4 req-728954db-9df3-4172-a4ee-a6b76b26c88b service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-7d9b2607-9215-455b-8994-da8e00512ac4 req-728954db-9df3-4172-a4ee-a6b76b26c88b service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] No waiting events found dispatching network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:54 user nova-compute[75813]: WARNING nova.compute.manager [req-7d9b2607-9215-455b-8994-da8e00512ac4 req-728954db-9df3-4172-a4ee-a6b76b26c88b service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received unexpected event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 13:03:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:03:56 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Instance spawned successfully.
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-48eec704-ede1-4773-9873-f9802d50cf42 req-3795f2ec-24db-4d83-984d-74d9ffff5bb7 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-48eec704-ede1-4773-9873-f9802d50cf42 req-3795f2ec-24db-4d83-984d-74d9ffff5bb7 service nova] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-48eec704-ede1-4773-9873-f9802d50cf42 req-3795f2ec-24db-4d83-984d-74d9ffff5bb7 service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-48eec704-ede1-4773-9873-f9802d50cf42 req-3795f2ec-24db-4d83-984d-74d9ffff5bb7 service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-48eec704-ede1-4773-9873-f9802d50cf42 req-3795f2ec-24db-4d83-984d-74d9ffff5bb7 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] No waiting events found dispatching network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:03:56 user nova-compute[75813]: WARNING nova.compute.manager [req-48eec704-ede1-4773-9873-f9802d50cf42 req-3795f2ec-24db-4d83-984d-74d9ffff5bb7 service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received unexpected event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG nova.objects.instance [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75813) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7963c013-f6d0-4dc8-a1ad-085b0f7181ea tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.085s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:03:58 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Creating image(s)
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Ensure instance console log exists: /opt/stack/data/nova/instances/4210006e-5842-432d-99ba-3849899c9713/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Start _get_guest_xml network_info=[{"id": "108ec246-893b-4e48-abb2-2c71032180e3", "address": "fa:16:3e:c4:47:83", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ec246-89", "ovs_interfaceid": "108ec246-893b-4e48-abb2-2c71032180e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '3294cbbd-435f-4d67-9d13-f178da3fdfc0', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRNDfpue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4210006e-5842-432d-99ba-3849899c9713', 'attached_at': '', 'detached_at': '', 'volume_id': '74eda169-03ee-488b-a4a0-e0164b8900a5', 'serial': '74eda169-03ee-488b-a4a0-e0164b8900a5'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:03:58 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:03:58 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRNDfpue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:03:58 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:58 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:03:58 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bbe3a8-3eaf-4514-82b7-913e2b8c5942]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:03:58 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eef212c-d147-40a8-be82-6b9281a33330]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5] added
Nov 15 13:03:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d5442e-1f54-48eb-af20-f558e6e320b8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65cdbf6-7d14-4356-8ca5-177274cd094a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRNDfpue {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRNDfpue" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4e7923-7857-42f8-b92d-6ee02f2ba7ff]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CRNDfpue'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84932f1-6810-48c8-97e3-2e74b84102d6]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1bc4dd-36b7-4ffe-975f-a423d4bb6a26]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:58 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:58 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:03:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:58 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:58 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:03:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[048f72ca-519a-4e1f-b6e2-6e7c80ca5116]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5, portal: 172.16.0.220,3260]
Nov 15 13:03:58 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5, portal: 172.16.0.220,3260] successful.
Nov 15 13:03:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2a92af-0e6a-44c7-8f7c-0aa3e96cd9d0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a05589-ea7a-4adb-9b83-b3c327645cf9]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:58 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:58 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:03:58 user nova-compute[75813]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 (non-flash)
Nov 15 13:03:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:03:58 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:03:58 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:03:58 user nova-compute[75813]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 (non-flash)
Nov 15 13:03:58 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[850e16be-1259-4412-ad7a-ef71d54fffe8]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRNDfpue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:03:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:03:59 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:03:59 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8342MB free_disk=25.020687103271484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 9fed6377-0614-41ae-b421-75d74da5fa4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4210006e-5842-432d-99ba-3849899c9713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26630333137646338', 'path': '/dev/sde'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630333137646338', 'path': '/dev/sde'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1722824994',display_name='tempest-TestVolumeBootPattern-server-1722824994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1722824994',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-0ocw3rho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:03:47Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=4210006e-5842-432d-99ba-3849899c9713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "108ec246-893b-4e48-abb2-2c71032180e3", "address": "fa:16:3e:c4:47:83", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ec246-89", "ovs_interfaceid": "108ec246-893b-4e48-abb2-2c71032180e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "108ec246-893b-4e48-abb2-2c71032180e3", "address": "fa:16:3e:c4:47:83", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ec246-89", "ovs_interfaceid": "108ec246-893b-4e48-abb2-2c71032180e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:47:83,bridge_name='br-int',has_traffic_filtering=True,id=108ec246-893b-4e48-abb2-2c71032180e3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108ec246-89') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.objects.instance [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'pci_devices' on Instance uuid 4210006e-5842-432d-99ba-3849899c9713 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:03:59 user nova-compute[75813]:   <uuid>4210006e-5842-432d-99ba-3849899c9713</uuid>
Nov 15 13:03:59 user nova-compute[75813]:   <name>instance-0000001d</name>
Nov 15 13:03:59 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:03:59 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:03:59 user nova-compute[75813]:   <metadata>
Nov 15 13:03:59 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:03:59 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:03:59 user nova-compute[75813]:       <nova:name>tempest-TestVolumeBootPattern-server-1722824994</nova:name>
Nov 15 13:03:59 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:03:58</nova:creationTime>
Nov 15 13:03:59 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:03:59 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:03:59 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:03:59 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:03:59 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:03:59 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:03:59 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:03:59 user nova-compute[75813]:       <nova:owner>
Nov 15 13:03:59 user nova-compute[75813]:         <nova:user uuid="3bc41f21cddc40e7a287b6f809233a65">tempest-TestVolumeBootPattern-678819035-project-member</nova:user>
Nov 15 13:03:59 user nova-compute[75813]:         <nova:project uuid="63086918b1c84a608c4a5aebf968eab5">tempest-TestVolumeBootPattern-678819035</nova:project>
Nov 15 13:03:59 user nova-compute[75813]:       </nova:owner>
Nov 15 13:03:59 user nova-compute[75813]:       <nova:ports>
Nov 15 13:03:59 user nova-compute[75813]:         <nova:port uuid="108ec246-893b-4e48-abb2-2c71032180e3">
Nov 15 13:03:59 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 13:03:59 user nova-compute[75813]:         </nova:port>
Nov 15 13:03:59 user nova-compute[75813]:       </nova:ports>
Nov 15 13:03:59 user nova-compute[75813]:     </nova:instance>
Nov 15 13:03:59 user nova-compute[75813]:   </metadata>
Nov 15 13:03:59 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:03:59 user nova-compute[75813]:     <system>
Nov 15 13:03:59 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:03:59 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:03:59 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:03:59 user nova-compute[75813]:       <entry name="serial">4210006e-5842-432d-99ba-3849899c9713</entry>
Nov 15 13:03:59 user nova-compute[75813]:       <entry name="uuid">4210006e-5842-432d-99ba-3849899c9713</entry>
Nov 15 13:03:59 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:03:59 user nova-compute[75813]:     </system>
Nov 15 13:03:59 user nova-compute[75813]:   </sysinfo>
Nov 15 13:03:59 user nova-compute[75813]:   <os>
Nov 15 13:03:59 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:03:59 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:03:59 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:03:59 user nova-compute[75813]:   </os>
Nov 15 13:03:59 user nova-compute[75813]:   <features>
Nov 15 13:03:59 user nova-compute[75813]:     <acpi/>
Nov 15 13:03:59 user nova-compute[75813]:     <apic/>
Nov 15 13:03:59 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:03:59 user nova-compute[75813]:   </features>
Nov 15 13:03:59 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:03:59 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:03:59 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:03:59 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:03:59 user nova-compute[75813]:   </clock>
Nov 15 13:03:59 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:03:59 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:03:59 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:03:59 user nova-compute[75813]:   </cpu>
Nov 15 13:03:59 user nova-compute[75813]:   <devices>
Nov 15 13:03:59 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:03:59 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:03:59 user nova-compute[75813]:       <source dev="/dev/sde"/>
Nov 15 13:03:59 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:03:59 user nova-compute[75813]:       <serial>74eda169-03ee-488b-a4a0-e0164b8900a5</serial>
Nov 15 13:03:59 user nova-compute[75813]:     </disk>
Nov 15 13:03:59 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:03:59 user nova-compute[75813]:       <mac address="fa:16:3e:c4:47:83"/>
Nov 15 13:03:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:03:59 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:03:59 user nova-compute[75813]:       <target dev="tap108ec246-89"/>
Nov 15 13:03:59 user nova-compute[75813]:     </interface>
Nov 15 13:03:59 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:03:59 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/4210006e-5842-432d-99ba-3849899c9713/console.log" append="off"/>
Nov 15 13:03:59 user nova-compute[75813]:     </serial>
Nov 15 13:03:59 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:03:59 user nova-compute[75813]:     <video>
Nov 15 13:03:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:03:59 user nova-compute[75813]:     </video>
Nov 15 13:03:59 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:03:59 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:03:59 user nova-compute[75813]:     </rng>
Nov 15 13:03:59 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:03:59 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:03:59 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:03:59 user nova-compute[75813]:     </memballoon>
Nov 15 13:03:59 user nova-compute[75813]:   </devices>
Nov 15 13:03:59 user nova-compute[75813]: </domain>
Nov 15 13:03:59 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1722824994',display_name='tempest-TestVolumeBootPattern-server-1722824994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1722824994',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-0ocw3rho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:03:47Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=4210006e-5842-432d-99ba-3849899c9713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "108ec246-893b-4e48-abb2-2c71032180e3", "address": "fa:16:3e:c4:47:83", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ec246-89", "ovs_interfaceid": "108ec246-893b-4e48-abb2-2c71032180e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "108ec246-893b-4e48-abb2-2c71032180e3", "address": "fa:16:3e:c4:47:83", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ec246-89", "ovs_interfaceid": "108ec246-893b-4e48-abb2-2c71032180e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:47:83,bridge_name='br-int',has_traffic_filtering=True,id=108ec246-893b-4e48-abb2-2c71032180e3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108ec246-89') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG os_vif [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:47:83,bridge_name='br-int',has_traffic_filtering=True,id=108ec246-893b-4e48-abb2-2c71032180e3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108ec246-89') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e26fefd2-9d4d-5f5a-a2ad-773777f1b6f6', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap108ec246-89, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap108ec246-89, col_values=(('qos', UUID('e5921667-ff44-4e19-ae9d-cca5d23092cd')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap108ec246-89, col_values=(('external_ids', {'iface-id': '108ec246-893b-4e48-abb2-2c71032180e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:47:83', 'vm-uuid': '4210006e-5842-432d-99ba-3849899c9713'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:03:59 user nova-compute[75813]: INFO os_vif [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:47:83,bridge_name='br-int',has_traffic_filtering=True,id=108ec246-893b-4e48-abb2-2c71032180e3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108ec246-89')
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:03:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No VIF found with MAC fa:16:3e:c4:47:83, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:04:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-3af5eecf-ad91-4d53-93c7-f324662240e0 req-6b8bbdcf-87ae-4313-b1e9-3154c50f31f9 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Received event network-vif-plugged-108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3af5eecf-ad91-4d53-93c7-f324662240e0 req-6b8bbdcf-87ae-4313-b1e9-3154c50f31f9 service nova] Acquiring lock "4210006e-5842-432d-99ba-3849899c9713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3af5eecf-ad91-4d53-93c7-f324662240e0 req-6b8bbdcf-87ae-4313-b1e9-3154c50f31f9 service nova] Lock "4210006e-5842-432d-99ba-3849899c9713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3af5eecf-ad91-4d53-93c7-f324662240e0 req-6b8bbdcf-87ae-4313-b1e9-3154c50f31f9 service nova] Lock "4210006e-5842-432d-99ba-3849899c9713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-3af5eecf-ad91-4d53-93c7-f324662240e0 req-6b8bbdcf-87ae-4313-b1e9-3154c50f31f9 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] No waiting events found dispatching network-vif-plugged-108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:04:01 user nova-compute[75813]: WARNING nova.compute.manager [req-3af5eecf-ad91-4d53-93c7-f324662240e0 req-6b8bbdcf-87ae-4313-b1e9-3154c50f31f9 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Received unexpected event network-vif-plugged-108ec246-893b-4e48-abb2-2c71032180e3 for instance with vm_state building and task_state spawning.
Nov 15 13:04:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:04:03 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 4210006e-5842-432d-99ba-3849899c9713] Instance spawned successfully.
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:03 user nova-compute[75813]: INFO nova.compute.manager [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:04:03 user nova-compute[75813]: INFO nova.compute.manager [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Took 16.64 seconds to build instance.
Nov 15 13:04:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa9f0cac-27ce-43f6-bb98-475df42a056e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "4210006e-5842-432d-99ba-3849899c9713" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.737s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-16e2c01d-ff53-4815-9ee3-9b37f77de68b req-796caa7c-2669-48a5-880d-8b36bbb12850 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Received event network-vif-plugged-108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-16e2c01d-ff53-4815-9ee3-9b37f77de68b req-796caa7c-2669-48a5-880d-8b36bbb12850 service nova] Acquiring lock "4210006e-5842-432d-99ba-3849899c9713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-16e2c01d-ff53-4815-9ee3-9b37f77de68b req-796caa7c-2669-48a5-880d-8b36bbb12850 service nova] Lock "4210006e-5842-432d-99ba-3849899c9713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-16e2c01d-ff53-4815-9ee3-9b37f77de68b req-796caa7c-2669-48a5-880d-8b36bbb12850 service nova] Lock "4210006e-5842-432d-99ba-3849899c9713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-16e2c01d-ff53-4815-9ee3-9b37f77de68b req-796caa7c-2669-48a5-880d-8b36bbb12850 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] No waiting events found dispatching network-vif-plugged-108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:04:03 user nova-compute[75813]: WARNING nova.compute.manager [req-16e2c01d-ff53-4815-9ee3-9b37f77de68b req-796caa7c-2669-48a5-880d-8b36bbb12850 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Received unexpected event network-vif-plugged-108ec246-893b-4e48-abb2-2c71032180e3 for instance with vm_state active and task_state None.
Nov 15 13:04:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:09 user nova-compute[75813]: INFO nova.compute.manager [None req-7f604149-c641-4cc8-91d6-adba833daa89 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Unrescuing
Nov 15 13:04:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7f604149-c641-4cc8-91d6-adba833daa89 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:04:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7f604149-c641-4cc8-91d6-adba833daa89 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquired lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:04:09 user nova-compute[75813]: DEBUG nova.network.neutron [None req-7f604149-c641-4cc8-91d6-adba833daa89 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:04:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:09 user nova-compute[75813]: DEBUG nova.network.neutron [None req-7f604149-c641-4cc8-91d6-adba833daa89 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updating instance_info_cache with network_info: [{"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:04:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7f604149-c641-4cc8-91d6-adba833daa89 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Releasing lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:04:09 user nova-compute[75813]: DEBUG nova.objects.instance [None req-7f604149-c641-4cc8-91d6-adba833daa89 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'flavor' on Instance uuid 4ae1ec46-9edc-477d-a9c1-2455a76bda4e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:04:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-e165f07d-42ec-41f9-9432-1a3a42d38737 req-54c9505b-e4a5-46f6-b8fc-0077055f930a service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-unplugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:04:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e165f07d-42ec-41f9-9432-1a3a42d38737 req-54c9505b-e4a5-46f6-b8fc-0077055f930a service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e165f07d-42ec-41f9-9432-1a3a42d38737 req-54c9505b-e4a5-46f6-b8fc-0077055f930a service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e165f07d-42ec-41f9-9432-1a3a42d38737 req-54c9505b-e4a5-46f6-b8fc-0077055f930a service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-e165f07d-42ec-41f9-9432-1a3a42d38737 req-54c9505b-e4a5-46f6-b8fc-0077055f930a service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-unplugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:04:10 user nova-compute[75813]: WARNING nova.compute.manager [req-e165f07d-42ec-41f9-9432-1a3a42d38737 req-54c9505b-e4a5-46f6-b8fc-0077055f930a service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received unexpected event network-vif-unplugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:04:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:10 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Instance destroyed successfully.
Nov 15 13:04:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:04:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:04:12 user nova-compute[75813]: WARNING nova.compute.manager [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received unexpected event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:04:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:04:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:04:12 user nova-compute[75813]: WARNING nova.compute.manager [req-8dca20cb-f180-46d8-a994-2ec33a7e5854 req-1e8450ff-583e-448c-b81f-79acee257349 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received unexpected event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:04:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-7f604149-c641-4cc8-91d6-adba833daa89 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:04:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-1b68703a-b79f-43ce-a976-13737e2d1d16 req-99d65da2-fedc-4fc1-861a-0d787aa31de6 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:04:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1b68703a-b79f-43ce-a976-13737e2d1d16 req-99d65da2-fedc-4fc1-861a-0d787aa31de6 service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1b68703a-b79f-43ce-a976-13737e2d1d16 req-99d65da2-fedc-4fc1-861a-0d787aa31de6 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1b68703a-b79f-43ce-a976-13737e2d1d16 req-99d65da2-fedc-4fc1-861a-0d787aa31de6 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-1b68703a-b79f-43ce-a976-13737e2d1d16 req-99d65da2-fedc-4fc1-861a-0d787aa31de6 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:04:14 user nova-compute[75813]: WARNING nova.compute.manager [req-1b68703a-b79f-43ce-a976-13737e2d1d16 req-99d65da2-fedc-4fc1-861a-0d787aa31de6 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received unexpected event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with vm_state active and task_state None.
Nov 15 13:04:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 70ddb35e-bc7c-4e18-8028-54496eef0cce {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 2153a37a-4973-4008-b20c-1bd03dbc39c1 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 4ae1ec46-9edc-477d-a9c1-2455a76bda4e {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 4210006e-5842-432d-99ba-3849899c9713 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 01c3ee8c-322c-42c6-8c33-22ae16e77c46 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "4210006e-5842-432d-99ba-3849899c9713" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "4210006e-5842-432d-99ba-3849899c9713" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "4210006e-5842-432d-99ba-3849899c9713" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:04:39 user nova-compute[75813]: INFO nova.compute.claims [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Claim successful on node user
Nov 15 13:04:39 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:04:39 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:04:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG nova.policy [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f3642a668cd4e998ffbaf8f76f5d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eaef11927a74bd4a8dfa8f6a11ab367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:04:39 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Creating image(s)
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "/opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "/opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "/opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk 1073741824" returned: 0 in 0.063s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Successfully created port: 76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Cannot resize image /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Ensure instance console log exists: /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Successfully updated port: 76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquired lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.compute.manager [req-c009eed7-5891-4104-a5ba-828e0553fd58 req-cc4ed17f-3686-45e4-86b4-cca6c633f954 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-changed-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.compute.manager [req-c009eed7-5891-4104-a5ba-828e0553fd58 req-cc4ed17f-3686-45e4-86b4-cca6c633f954 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Refreshing instance network info cache due to event network-changed-76c7059b-cb68-4832-940f-9832e339c26c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c009eed7-5891-4104-a5ba-828e0553fd58 req-cc4ed17f-3686-45e4-86b4-cca6c633f954 service nova] Acquiring lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Updating instance_info_cache with network_info: [{"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Releasing lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Instance network_info: |[{"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c009eed7-5891-4104-a5ba-828e0553fd58 req-cc4ed17f-3686-45e4-86b4-cca6c633f954 service nova] Acquired lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.network.neutron [req-c009eed7-5891-4104-a5ba-828e0553fd58 req-cc4ed17f-3686-45e4-86b4-cca6c633f954 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Refreshing network info cache for port 76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Start _get_guest_xml network_info=[{"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:04:41 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:04:41 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-781384000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-781384000',id=30,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkUDCIMVpwJ2r5TfPwzRES7t2GVPpTHPcXaXt0ic3Rfm82sQfAAbf7CBQlEcYuXdL5tZfjX3t098yw/VS91DddIz1diZsymHOmYVBXCjVDBeI8TxiFp73nljQa0QLd50g==',key_name='tempest-keypair-1610888735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-5d7gag7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=b74022f2-55af-4eb7-81e0-4696fefd5ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'pci_devices' on Instance uuid b74022f2-55af-4eb7-81e0-4696fefd5ae5 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:04:41 user nova-compute[75813]:   <uuid>b74022f2-55af-4eb7-81e0-4696fefd5ae5</uuid>
Nov 15 13:04:41 user nova-compute[75813]:   <name>instance-0000001e</name>
Nov 15 13:04:41 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:04:41 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:04:41 user nova-compute[75813]:   <metadata>
Nov 15 13:04:41 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:04:41 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:04:41 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-781384000</nova:name>
Nov 15 13:04:41 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:04:41</nova:creationTime>
Nov 15 13:04:41 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:04:41 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:04:41 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:04:41 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:04:41 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:04:41 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:04:41 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:04:41 user nova-compute[75813]:       <nova:owner>
Nov 15 13:04:41 user nova-compute[75813]:         <nova:user uuid="7f3642a668cd4e998ffbaf8f76f5d895">tempest-AttachVolumeShelveTestJSON-1167418523-project-member</nova:user>
Nov 15 13:04:41 user nova-compute[75813]:         <nova:project uuid="8eaef11927a74bd4a8dfa8f6a11ab367">tempest-AttachVolumeShelveTestJSON-1167418523</nova:project>
Nov 15 13:04:41 user nova-compute[75813]:       </nova:owner>
Nov 15 13:04:41 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:04:41 user nova-compute[75813]:       <nova:ports>
Nov 15 13:04:41 user nova-compute[75813]:         <nova:port uuid="76c7059b-cb68-4832-940f-9832e339c26c">
Nov 15 13:04:41 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 13:04:41 user nova-compute[75813]:         </nova:port>
Nov 15 13:04:41 user nova-compute[75813]:       </nova:ports>
Nov 15 13:04:41 user nova-compute[75813]:     </nova:instance>
Nov 15 13:04:41 user nova-compute[75813]:   </metadata>
Nov 15 13:04:41 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:04:41 user nova-compute[75813]:     <system>
Nov 15 13:04:41 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:04:41 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:04:41 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:04:41 user nova-compute[75813]:       <entry name="serial">b74022f2-55af-4eb7-81e0-4696fefd5ae5</entry>
Nov 15 13:04:41 user nova-compute[75813]:       <entry name="uuid">b74022f2-55af-4eb7-81e0-4696fefd5ae5</entry>
Nov 15 13:04:41 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:04:41 user nova-compute[75813]:     </system>
Nov 15 13:04:41 user nova-compute[75813]:   </sysinfo>
Nov 15 13:04:41 user nova-compute[75813]:   <os>
Nov 15 13:04:41 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:04:41 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:04:41 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:04:41 user nova-compute[75813]:   </os>
Nov 15 13:04:41 user nova-compute[75813]:   <features>
Nov 15 13:04:41 user nova-compute[75813]:     <acpi/>
Nov 15 13:04:41 user nova-compute[75813]:     <apic/>
Nov 15 13:04:41 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:04:41 user nova-compute[75813]:   </features>
Nov 15 13:04:41 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:04:41 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:04:41 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:04:41 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:04:41 user nova-compute[75813]:   </clock>
Nov 15 13:04:41 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:04:41 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:04:41 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:04:41 user nova-compute[75813]:   </cpu>
Nov 15 13:04:41 user nova-compute[75813]:   <devices>
Nov 15 13:04:41 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:04:41 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:04:41 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk"/>
Nov 15 13:04:41 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:04:41 user nova-compute[75813]:     </disk>
Nov 15 13:04:41 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:04:41 user nova-compute[75813]:       <mac address="fa:16:3e:b6:23:56"/>
Nov 15 13:04:41 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:04:41 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:04:41 user nova-compute[75813]:       <target dev="tap76c7059b-cb"/>
Nov 15 13:04:41 user nova-compute[75813]:     </interface>
Nov 15 13:04:41 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:04:41 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/console.log" append="off"/>
Nov 15 13:04:41 user nova-compute[75813]:     </serial>
Nov 15 13:04:41 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:04:41 user nova-compute[75813]:     <video>
Nov 15 13:04:41 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:04:41 user nova-compute[75813]:     </video>
Nov 15 13:04:41 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:04:41 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:04:41 user nova-compute[75813]:     </rng>
Nov 15 13:04:41 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:04:41 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:04:41 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:04:41 user nova-compute[75813]:     </memballoon>
Nov 15 13:04:41 user nova-compute[75813]:   </devices>
Nov 15 13:04:41 user nova-compute[75813]: </domain>
Nov 15 13:04:41 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-781384000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-781384000',id=30,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkUDCIMVpwJ2r5TfPwzRES7t2GVPpTHPcXaXt0ic3Rfm82sQfAAbf7CBQlEcYuXdL5tZfjX3t098yw/VS91DddIz1diZsymHOmYVBXCjVDBeI8TxiFp73nljQa0QLd50g==',key_name='tempest-keypair-1610888735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-5d7gag7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=b74022f2-55af-4eb7-81e0-4696fefd5ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG os_vif [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '476b65c7-73f7-5a53-9371-8cea333be623', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76c7059b-cb, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76c7059b-cb, col_values=(('qos', UUID('46d67686-5f77-4822-9ffe-6bfc7930876b')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76c7059b-cb, col_values=(('external_ids', {'iface-id': '76c7059b-cb68-4832-940f-9832e339c26c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:23:56', 'vm-uuid': 'b74022f2-55af-4eb7-81e0-4696fefd5ae5'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:41 user nova-compute[75813]: INFO os_vif [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb')
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] No VIF found with MAC fa:16:3e:b6:23:56, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.network.neutron [req-c009eed7-5891-4104-a5ba-828e0553fd58 req-cc4ed17f-3686-45e4-86b4-cca6c633f954 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Updated VIF entry in instance network info cache for port 76c7059b-cb68-4832-940f-9832e339c26c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG nova.network.neutron [req-c009eed7-5891-4104-a5ba-828e0553fd58 req-cc4ed17f-3686-45e4-86b4-cca6c633f954 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Updating instance_info_cache with network_info: [{"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:04:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c009eed7-5891-4104-a5ba-828e0553fd58 req-cc4ed17f-3686-45e4-86b4-cca6c633f954 service nova] Releasing lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:04:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-893aec61-c735-4c53-9c26-0322ac26eede req-c8dba58b-4bc9-4786-b6f7-4e75aa101dc9 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:04:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-893aec61-c735-4c53-9c26-0322ac26eede req-c8dba58b-4bc9-4786-b6f7-4e75aa101dc9 service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-893aec61-c735-4c53-9c26-0322ac26eede req-c8dba58b-4bc9-4786-b6f7-4e75aa101dc9 service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-893aec61-c735-4c53-9c26-0322ac26eede req-c8dba58b-4bc9-4786-b6f7-4e75aa101dc9 service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-893aec61-c735-4c53-9c26-0322ac26eede req-c8dba58b-4bc9-4786-b6f7-4e75aa101dc9 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:04:43 user nova-compute[75813]: WARNING nova.compute.manager [req-893aec61-c735-4c53-9c26-0322ac26eede req-c8dba58b-4bc9-4786-b6f7-4e75aa101dc9 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received unexpected event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with vm_state building and task_state spawning.
Nov 15 13:04:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:04:45 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Instance spawned successfully.
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-8acb99c5-a8a8-4792-87e5-5e449bebcfdc req-6171bc19-fe39-4c3f-bff3-cdde2fdc94aa service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8acb99c5-a8a8-4792-87e5-5e449bebcfdc req-6171bc19-fe39-4c3f-bff3-cdde2fdc94aa service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8acb99c5-a8a8-4792-87e5-5e449bebcfdc req-6171bc19-fe39-4c3f-bff3-cdde2fdc94aa service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8acb99c5-a8a8-4792-87e5-5e449bebcfdc req-6171bc19-fe39-4c3f-bff3-cdde2fdc94aa service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-8acb99c5-a8a8-4792-87e5-5e449bebcfdc req-6171bc19-fe39-4c3f-bff3-cdde2fdc94aa service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:04:45 user nova-compute[75813]: WARNING nova.compute.manager [req-8acb99c5-a8a8-4792-87e5-5e449bebcfdc req-6171bc19-fe39-4c3f-bff3-cdde2fdc94aa service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received unexpected event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with vm_state building and task_state spawning.
Nov 15 13:04:45 user nova-compute[75813]: INFO nova.compute.manager [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 15 13:04:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:04:45 user nova-compute[75813]: INFO nova.compute.manager [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Took 6.32 seconds to build instance.
Nov 15 13:04:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3411b22-8635-46ae-8fc9-e5c095ab2931 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.408s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:04:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:04:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:04:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:04:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:04:48 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updating instance_info_cache with network_info: [{"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:04:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:04:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:04:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:04:49 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:04:49 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:04:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:04:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:04:54 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:04:54 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:04:54 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:56 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:57 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:04:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:04:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:04:58 user nova-compute[75813]: DEBUG nova.objects.instance [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquired lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.network.neutron [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.objects.instance [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'info_cache' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:04:59 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:04:59 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8229MB free_disk=24.990535736083984GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.objects.base [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 9fed6377-0614-41ae-b421-75d74da5fa4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4210006e-5842-432d-99ba-3849899c9713 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance b74022f2-55af-4eb7-81e0-4696fefd5ae5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.network.neutron [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updating instance_info_cache with network_info: [{"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Releasing lock "refresh_cache-525b3797-8d57-4bff-8ad9-4d53a8beaea4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:04:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance destroyed successfully.
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.objects.instance [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'resources' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.objects.base [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1560614732',display_name='tempest-AttachVolumeTestJSON-server-1560614732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1560614732',id=21,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnbNba04CbeL7eAssBt/FmQ/iYfKbd5Suudux+Uq/+hDAu0UbaSznFUIXj3nEyetGtTpXd7+WYrSD1d+9oe6ooGQlSFefp1/qlmhmSqQ0sJ7qT77xL5D4H51OLc73q6+w==',key_name='tempest-keypair-1745276063',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-8n5drqmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=525b3797-8d57-4bff-8ad9-4d53a8beaea4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG os_vif [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8472db86-c1, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc5b6c12-e552-43f1-ab4a-89fab5c4f9ce) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:04:59 user nova-compute[75813]: INFO os_vif [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1')
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Start _get_guest_xml network_info=[{"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.objects.instance [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'numa_topology' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.objects.base [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:04:59 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:04:59 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.objects.instance [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'vcpu_model' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.objects.base [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1560614732',display_name='tempest-AttachVolumeTestJSON-server-1560614732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1560614732',id=21,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnbNba04CbeL7eAssBt/FmQ/iYfKbd5Suudux+Uq/+hDAu0UbaSznFUIXj3nEyetGtTpXd7+WYrSD1d+9oe6ooGQlSFefp1/qlmhmSqQ0sJ7qT77xL5D4H51OLc73q6+w==',key_name='tempest-keypair-1745276063',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-8n5drqmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=525b3797-8d57-4bff-8ad9-4d53a8beaea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.objects.instance [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'pci_devices' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.objects.base [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:04:59 user nova-compute[75813]:   <uuid>525b3797-8d57-4bff-8ad9-4d53a8beaea4</uuid>
Nov 15 13:04:59 user nova-compute[75813]:   <name>instance-00000015</name>
Nov 15 13:04:59 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:04:59 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:04:59 user nova-compute[75813]:   <metadata>
Nov 15 13:04:59 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:04:59 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:04:59 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeTestJSON-server-1560614732</nova:name>
Nov 15 13:04:59 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:04:59</nova:creationTime>
Nov 15 13:04:59 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:04:59 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:04:59 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:04:59 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:04:59 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:04:59 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:04:59 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:04:59 user nova-compute[75813]:       <nova:owner>
Nov 15 13:04:59 user nova-compute[75813]:         <nova:user uuid="f68d31c0d9bc4a66b3d81a892dee65ef">tempest-AttachVolumeTestJSON-45300677-project-member</nova:user>
Nov 15 13:04:59 user nova-compute[75813]:         <nova:project uuid="fc78719b197c4db7bc6a13e3a57f3cb2">tempest-AttachVolumeTestJSON-45300677</nova:project>
Nov 15 13:04:59 user nova-compute[75813]:       </nova:owner>
Nov 15 13:04:59 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:04:59 user nova-compute[75813]:       <nova:ports>
Nov 15 13:04:59 user nova-compute[75813]:         <nova:port uuid="8472db86-c1ef-4c6a-a878-5951fa94e2e1">
Nov 15 13:04:59 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 13:04:59 user nova-compute[75813]:         </nova:port>
Nov 15 13:04:59 user nova-compute[75813]:       </nova:ports>
Nov 15 13:04:59 user nova-compute[75813]:     </nova:instance>
Nov 15 13:04:59 user nova-compute[75813]:   </metadata>
Nov 15 13:04:59 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:04:59 user nova-compute[75813]:     <system>
Nov 15 13:04:59 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:04:59 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:04:59 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:04:59 user nova-compute[75813]:       <entry name="serial">525b3797-8d57-4bff-8ad9-4d53a8beaea4</entry>
Nov 15 13:04:59 user nova-compute[75813]:       <entry name="uuid">525b3797-8d57-4bff-8ad9-4d53a8beaea4</entry>
Nov 15 13:04:59 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:04:59 user nova-compute[75813]:     </system>
Nov 15 13:04:59 user nova-compute[75813]:   </sysinfo>
Nov 15 13:04:59 user nova-compute[75813]:   <os>
Nov 15 13:04:59 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:04:59 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:04:59 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:04:59 user nova-compute[75813]:   </os>
Nov 15 13:04:59 user nova-compute[75813]:   <features>
Nov 15 13:04:59 user nova-compute[75813]:     <acpi/>
Nov 15 13:04:59 user nova-compute[75813]:     <apic/>
Nov 15 13:04:59 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:04:59 user nova-compute[75813]:   </features>
Nov 15 13:04:59 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:04:59 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:04:59 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:04:59 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:04:59 user nova-compute[75813]:   </clock>
Nov 15 13:04:59 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:04:59 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:04:59 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:04:59 user nova-compute[75813]:   </cpu>
Nov 15 13:04:59 user nova-compute[75813]:   <devices>
Nov 15 13:04:59 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:04:59 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:04:59 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk"/>
Nov 15 13:04:59 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:04:59 user nova-compute[75813]:     </disk>
Nov 15 13:04:59 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:04:59 user nova-compute[75813]:       <mac address="fa:16:3e:2f:03:54"/>
Nov 15 13:04:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:04:59 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:04:59 user nova-compute[75813]:       <target dev="tap8472db86-c1"/>
Nov 15 13:04:59 user nova-compute[75813]:     </interface>
Nov 15 13:04:59 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:04:59 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/console.log" append="off"/>
Nov 15 13:04:59 user nova-compute[75813]:     </serial>
Nov 15 13:04:59 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:04:59 user nova-compute[75813]:     <video>
Nov 15 13:04:59 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:04:59 user nova-compute[75813]:     </video>
Nov 15 13:04:59 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:04:59 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:04:59 user nova-compute[75813]:     </rng>
Nov 15 13:04:59 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:04:59 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:04:59 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:04:59 user nova-compute[75813]:     </memballoon>
Nov 15 13:04:59 user nova-compute[75813]:   </devices>
Nov 15 13:04:59 user nova-compute[75813]: </domain>
Nov 15 13:04:59 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:04:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG nova.objects.instance [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'trusted_certs' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG nova.objects.base [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Cannot resize image /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG nova.objects.instance [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'migration_context' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG nova.objects.base [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Object Instance<525b3797-8d57-4bff-8ad9-4d53a8beaea4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1560614732',display_name='tempest-AttachVolumeTestJSON-server-1560614732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1560614732',id=21,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnbNba04CbeL7eAssBt/FmQ/iYfKbd5Suudux+Uq/+hDAu0UbaSznFUIXj3nEyetGtTpXd7+WYrSD1d+9oe6ooGQlSFefp1/qlmhmSqQ0sJ7qT77xL5D4H51OLc73q6+w==',key_name='tempest-keypair-1745276063',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-8n5drqmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=525b3797-8d57-4bff-8ad9-4d53a8beaea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG os_vif [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3878150a-a48e-5455-9d92-d6557040766e', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8472db86-c1, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8472db86-c1, col_values=(('qos', UUID('acdc4ed4-6771-4de8-b083-4db2c7b449a5')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8472db86-c1, col_values=(('external_ids', {'iface-id': '8472db86-c1ef-4c6a-a878-5951fa94e2e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:03:54', 'vm-uuid': '525b3797-8d57-4bff-8ad9-4d53a8beaea4'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:00 user nova-compute[75813]: INFO os_vif [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1')
Nov 15 13:05:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-d022e74e-4c1c-42db-b2ec-4a48d1068403 req-5311861d-4731-4bd8-9398-063774ec3e86 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:05:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d022e74e-4c1c-42db-b2ec-4a48d1068403 req-5311861d-4731-4bd8-9398-063774ec3e86 service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d022e74e-4c1c-42db-b2ec-4a48d1068403 req-5311861d-4731-4bd8-9398-063774ec3e86 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d022e74e-4c1c-42db-b2ec-4a48d1068403 req-5311861d-4731-4bd8-9398-063774ec3e86 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-d022e74e-4c1c-42db-b2ec-4a48d1068403 req-5311861d-4731-4bd8-9398-063774ec3e86 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:05:02 user nova-compute[75813]: WARNING nova.compute.manager [req-d022e74e-4c1c-42db-b2ec-4a48d1068403 req-5311861d-4731-4bd8-9398-063774ec3e86 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received unexpected event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with vm_state stopped and task_state powering-on.
Nov 15 13:05:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:04 user nova-compute[75813]: DEBUG nova.compute.manager [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:05:04 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance rebooted successfully.
Nov 15 13:05:04 user nova-compute[75813]: DEBUG nova.compute.manager [None req-20d87f75-b97c-4dc8-8e4d-54606aee6e10 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:05:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-da307258-1d96-4952-979e-55d59f881055 req-fb262ed3-9b4b-4052-8cea-07e45410dc85 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:05:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-da307258-1d96-4952-979e-55d59f881055 req-fb262ed3-9b4b-4052-8cea-07e45410dc85 service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-da307258-1d96-4952-979e-55d59f881055 req-fb262ed3-9b4b-4052-8cea-07e45410dc85 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-da307258-1d96-4952-979e-55d59f881055 req-fb262ed3-9b4b-4052-8cea-07e45410dc85 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-da307258-1d96-4952-979e-55d59f881055 req-fb262ed3-9b4b-4052-8cea-07e45410dc85 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:05:04 user nova-compute[75813]: WARNING nova.compute.manager [req-da307258-1d96-4952-979e-55d59f881055 req-fb262ed3-9b4b-4052-8cea-07e45410dc85 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received unexpected event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with vm_state active and task_state None.
Nov 15 13:05:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:14 user nova-compute[75813]: INFO nova.compute.manager [None req-1571c93f-cf42-4435-9af3-d7bae2eeef9d tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Unrescuing
Nov 15 13:05:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1571c93f-cf42-4435-9af3-d7bae2eeef9d tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:05:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1571c93f-cf42-4435-9af3-d7bae2eeef9d tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquired lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:05:14 user nova-compute[75813]: DEBUG nova.network.neutron [None req-1571c93f-cf42-4435-9af3-d7bae2eeef9d tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-1571c93f-cf42-4435-9af3-d7bae2eeef9d tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updating instance_info_cache with network_info: [{"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1571c93f-cf42-4435-9af3-d7bae2eeef9d tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Releasing lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG nova.objects.instance [None req-1571c93f-cf42-4435-9af3-d7bae2eeef9d tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'flavor' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-627963b4-077f-4779-9a88-46824cfe9cd5 req-71be0d87-5e62-4440-a4c5-a42654be54ef service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-unplugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-627963b4-077f-4779-9a88-46824cfe9cd5 req-71be0d87-5e62-4440-a4c5-a42654be54ef service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-627963b4-077f-4779-9a88-46824cfe9cd5 req-71be0d87-5e62-4440-a4c5-a42654be54ef service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-627963b4-077f-4779-9a88-46824cfe9cd5 req-71be0d87-5e62-4440-a4c5-a42654be54ef service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-627963b4-077f-4779-9a88-46824cfe9cd5 req-71be0d87-5e62-4440-a4c5-a42654be54ef service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-unplugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:05:15 user nova-compute[75813]: WARNING nova.compute.manager [req-627963b4-077f-4779-9a88-46824cfe9cd5 req-71be0d87-5e62-4440-a4c5-a42654be54ef service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received unexpected event network-vif-unplugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:05:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-273855bc-2523-469c-98b5-399e336b4c4e req-14604366-7795-45fd-aee4-d57826b0afe9 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-changed-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-273855bc-2523-469c-98b5-399e336b4c4e req-14604366-7795-45fd-aee4-d57826b0afe9 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Refreshing instance network info cache due to event network-changed-0855cbc5-0088-42fb-be12-422784a52b93. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-273855bc-2523-469c-98b5-399e336b4c4e req-14604366-7795-45fd-aee4-d57826b0afe9 service nova] Acquiring lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-273855bc-2523-469c-98b5-399e336b4c4e req-14604366-7795-45fd-aee4-d57826b0afe9 service nova] Acquired lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG nova.network.neutron [req-273855bc-2523-469c-98b5-399e336b4c4e req-14604366-7795-45fd-aee4-d57826b0afe9 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Refreshing network info cache for port 0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:05:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:16 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Instance destroyed successfully.
Nov 15 13:05:16 user nova-compute[75813]: DEBUG nova.network.neutron [req-273855bc-2523-469c-98b5-399e336b4c4e req-14604366-7795-45fd-aee4-d57826b0afe9 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updated VIF entry in instance network info cache for port 0855cbc5-0088-42fb-be12-422784a52b93. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:05:16 user nova-compute[75813]: DEBUG nova.network.neutron [req-273855bc-2523-469c-98b5-399e336b4c4e req-14604366-7795-45fd-aee4-d57826b0afe9 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updating instance_info_cache with network_info: [{"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:05:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-273855bc-2523-469c-98b5-399e336b4c4e req-14604366-7795-45fd-aee4-d57826b0afe9 service nova] Releasing lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:05:17 user nova-compute[75813]: WARNING nova.compute.manager [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received unexpected event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:05:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:05:17 user nova-compute[75813]: WARNING nova.compute.manager [req-45196a77-4604-4416-b31d-eca9019281c3 req-bbf3fee9-f107-4256-aefc-5299d1c9c2b0 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received unexpected event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:05:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-72645d23-f031-46ce-947c-e97abd0296a2 req-75d6a319-463d-4fdd-9aa2-da8e9af80fc6 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-changed-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:05:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-72645d23-f031-46ce-947c-e97abd0296a2 req-75d6a319-463d-4fdd-9aa2-da8e9af80fc6 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Refreshing instance network info cache due to event network-changed-0855cbc5-0088-42fb-be12-422784a52b93. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:05:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-72645d23-f031-46ce-947c-e97abd0296a2 req-75d6a319-463d-4fdd-9aa2-da8e9af80fc6 service nova] Acquiring lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:05:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-72645d23-f031-46ce-947c-e97abd0296a2 req-75d6a319-463d-4fdd-9aa2-da8e9af80fc6 service nova] Acquired lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:05:18 user nova-compute[75813]: DEBUG nova.network.neutron [req-72645d23-f031-46ce-947c-e97abd0296a2 req-75d6a319-463d-4fdd-9aa2-da8e9af80fc6 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Refreshing network info cache for port 0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:05:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:18 user nova-compute[75813]: DEBUG nova.network.neutron [req-72645d23-f031-46ce-947c-e97abd0296a2 req-75d6a319-463d-4fdd-9aa2-da8e9af80fc6 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updated VIF entry in instance network info cache for port 0855cbc5-0088-42fb-be12-422784a52b93. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:05:18 user nova-compute[75813]: DEBUG nova.network.neutron [req-72645d23-f031-46ce-947c-e97abd0296a2 req-75d6a319-463d-4fdd-9aa2-da8e9af80fc6 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updating instance_info_cache with network_info: [{"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:05:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-72645d23-f031-46ce-947c-e97abd0296a2 req-75d6a319-463d-4fdd-9aa2-da8e9af80fc6 service nova] Releasing lock "refresh_cache-9fed6377-0614-41ae-b421-75d74da5fa4f" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:05:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1571c93f-cf42-4435-9af3-d7bae2eeef9d tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:05:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-3eb53411-0029-4196-856b-53c02e662222 req-311c0ba5-d202-49e7-b224-d9f2a5153ead service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:05:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3eb53411-0029-4196-856b-53c02e662222 req-311c0ba5-d202-49e7-b224-d9f2a5153ead service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3eb53411-0029-4196-856b-53c02e662222 req-311c0ba5-d202-49e7-b224-d9f2a5153ead service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3eb53411-0029-4196-856b-53c02e662222 req-311c0ba5-d202-49e7-b224-d9f2a5153ead service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-3eb53411-0029-4196-856b-53c02e662222 req-311c0ba5-d202-49e7-b224-d9f2a5153ead service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:05:19 user nova-compute[75813]: WARNING nova.compute.manager [req-3eb53411-0029-4196-856b-53c02e662222 req-311c0ba5-d202-49e7-b224-d9f2a5153ead service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received unexpected event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with vm_state active and task_state None.
Nov 15 13:05:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "4210006e-5842-432d-99ba-3849899c9713" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "4210006e-5842-432d-99ba-3849899c9713" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "4210006e-5842-432d-99ba-3849899c9713-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "4210006e-5842-432d-99ba-3849899c9713-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "4210006e-5842-432d-99ba-3849899c9713-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:37 user nova-compute[75813]: INFO nova.compute.manager [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Terminating instance
Nov 15 13:05:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-5f664abb-a6ea-46ed-ace1-43971aa95f18 req-a32ec012-8143-42f4-b020-357f76a36470 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Received event network-vif-unplugged-108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5f664abb-a6ea-46ed-ace1-43971aa95f18 req-a32ec012-8143-42f4-b020-357f76a36470 service nova] Acquiring lock "4210006e-5842-432d-99ba-3849899c9713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5f664abb-a6ea-46ed-ace1-43971aa95f18 req-a32ec012-8143-42f4-b020-357f76a36470 service nova] Lock "4210006e-5842-432d-99ba-3849899c9713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5f664abb-a6ea-46ed-ace1-43971aa95f18 req-a32ec012-8143-42f4-b020-357f76a36470 service nova] Lock "4210006e-5842-432d-99ba-3849899c9713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-5f664abb-a6ea-46ed-ace1-43971aa95f18 req-a32ec012-8143-42f4-b020-357f76a36470 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] No waiting events found dispatching network-vif-unplugged-108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-5f664abb-a6ea-46ed-ace1-43971aa95f18 req-a32ec012-8143-42f4-b020-357f76a36470 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Received event network-vif-unplugged-108ec246-893b-4e48-abb2-2c71032180e3 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:37 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 4210006e-5842-432d-99ba-3849899c9713] Instance destroyed successfully.
Nov 15 13:05:37 user nova-compute[75813]: DEBUG nova.objects.instance [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'resources' on Instance uuid 4210006e-5842-432d-99ba-3849899c9713 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1722824994',display_name='tempest-TestVolumeBootPattern-server-1722824994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1722824994',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:04:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-0ocw3rho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:04:03Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=4210006e-5842-432d-99ba-3849899c9713,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "108ec246-893b-4e48-abb2-2c71032180e3", "address": "fa:16:3e:c4:47:83", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ec246-89", "ovs_interfaceid": "108ec246-893b-4e48-abb2-2c71032180e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "108ec246-893b-4e48-abb2-2c71032180e3", "address": "fa:16:3e:c4:47:83", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap108ec246-89", "ovs_interfaceid": "108ec246-893b-4e48-abb2-2c71032180e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:47:83,bridge_name='br-int',has_traffic_filtering=True,id=108ec246-893b-4e48-abb2-2c71032180e3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108ec246-89') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_vif [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:47:83,bridge_name='br-int',has_traffic_filtering=True,id=108ec246-893b-4e48-abb2-2c71032180e3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108ec246-89') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap108ec246-89, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5921667-ff44-4e19-ae9d-cca5d23092cd) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:05:37 user nova-compute[75813]: INFO os_vif [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:47:83,bridge_name='br-int',has_traffic_filtering=True,id=108ec246-893b-4e48-abb2-2c71032180e3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap108ec246-89')
Nov 15 13:05:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRNDfpue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:05:37 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8375cf-7984-4771-be6c-389c43a7e1a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:05:37 user nova-compute[75813]: No targets found.
Nov 15 13:05:37 user nova-compute[75813]: iSNS:
Nov 15 13:05:37 user nova-compute[75813]: No targets found.
Nov 15 13:05:37 user nova-compute[75813]: STATIC:
Nov 15 13:05:37 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:05:37 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:05:37 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:05:37 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd
Nov 15 13:05:37 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:05:37 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:05:37 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a
Nov 15 13:05:37 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:05:37 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:05:37 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5
Nov 15 13:05:37 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:05:37 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:05:37 user nova-compute[75813]: FIRMWARE:
Nov 15 13:05:37 user nova-compute[75813]: No targets found.
Nov 15 13:05:37 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:05:37 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:05:37 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dba3997-459d-4df3-9d8c-5b7fb9e0405d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd78f96-e203-4420-8e21-c9f27aee3618]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:05:37 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:05:37 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:05:37 user nova-compute[75813]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 (non-flash)
Nov 15 13:05:37 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:05:37 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:05:37 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:05:37 user nova-compute[75813]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 (non-flash)
Nov 15 13:05:37 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555186fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5'): ({'sde'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Removing single pathed devices sde {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e08e1ed-ede2-4b2c-a0d5-709619cc359d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc04945-14d5-4fb3-9c52-a6c76472562e]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flushing IO for device /dev/sde {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad54b300-1f31-40d1-8df3-b44ba9026f00]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:05:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eeb003-cea9-4427-a445-1e46d47ee32d]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO29e5fbd9-f0317dc88e2d275d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_29e5fbd9', '/dev/disk/by-id/scsi-26630333137646338') {{(pid=87167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[76361a07-6dca-425d-9bfc-c49fccf1a8e2]: (4, None) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a47ae2-ee24-4d2d-9f6d-6750c7172bd7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fee54b-a6db-4f89-ba8b-621c43f3695c]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5, portal: 172.16.0.220,3260]
Nov 15 13:05:38 user nova-compute[75813]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5, portal: 172.16.0.220,3260] successful.
Nov 15 13:05:38 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74eda169-03ee-488b-a4a0-e0164b8900a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b5ca4b-2bfe-4204-b2a5-795984463359]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== disconnect_volume: return (314ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:05:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Deleting instance files /opt/stack/data/nova/instances/4210006e-5842-432d-99ba-3849899c9713_del
Nov 15 13:05:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Deletion of /opt/stack/data/nova/instances/4210006e-5842-432d-99ba-3849899c9713_del complete
Nov 15 13:05:38 user nova-compute[75813]: INFO nova.compute.manager [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 13:05:38 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 4210006e-5842-432d-99ba-3849899c9713] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 4210006e-5842-432d-99ba-3849899c9713] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:05:38 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 4210006e-5842-432d-99ba-3849899c9713] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:05:38 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 4210006e-5842-432d-99ba-3849899c9713] Took 0.50 seconds to deallocate network for instance.
Nov 15 13:05:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-82ce8026-1920-4190-afa7-0431a02326fc req-fc5fdf44-a7c1-425c-ac04-610e7404bff5 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Received event network-vif-deleted-108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:05:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-5df4dc3e-79e4-4b62-941b-db329443d255 req-77ee7225-cdf9-4607-8d0d-9b2c030dd905 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Received event network-vif-plugged-108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:05:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5df4dc3e-79e4-4b62-941b-db329443d255 req-77ee7225-cdf9-4607-8d0d-9b2c030dd905 service nova] Acquiring lock "4210006e-5842-432d-99ba-3849899c9713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5df4dc3e-79e4-4b62-941b-db329443d255 req-77ee7225-cdf9-4607-8d0d-9b2c030dd905 service nova] Lock "4210006e-5842-432d-99ba-3849899c9713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5df4dc3e-79e4-4b62-941b-db329443d255 req-77ee7225-cdf9-4607-8d0d-9b2c030dd905 service nova] Lock "4210006e-5842-432d-99ba-3849899c9713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-5df4dc3e-79e4-4b62-941b-db329443d255 req-77ee7225-cdf9-4607-8d0d-9b2c030dd905 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] No waiting events found dispatching network-vif-plugged-108ec246-893b-4e48-abb2-2c71032180e3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:05:39 user nova-compute[75813]: WARNING nova.compute.manager [req-5df4dc3e-79e4-4b62-941b-db329443d255 req-77ee7225-cdf9-4607-8d0d-9b2c030dd905 service nova] [instance: 4210006e-5842-432d-99ba-3849899c9713] Received unexpected event network-vif-plugged-108ec246-893b-4e48-abb2-2c71032180e3 for instance with vm_state active and task_state deleting.
Nov 15 13:05:39 user nova-compute[75813]: INFO nova.compute.manager [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Took 0.73 seconds to detach 1 volumes for instance.
Nov 15 13:05:39 user nova-compute[75813]: DEBUG nova.compute.manager [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 4210006e-5842-432d-99ba-3849899c9713] Deleting volume: 74eda169-03ee-488b-a4a0-e0164b8900a5 {{(pid=75813) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 13:05:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:39 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:05:39 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:05:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:39 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Deleted allocations for instance 4210006e-5842-432d-99ba-3849899c9713
Nov 15 13:05:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473cdcc4-99c7-4058-95ae-92d6360e63d9 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "4210006e-5842-432d-99ba-3849899c9713" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.919s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:47 user nova-compute[75813]: INFO nova.compute.manager [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Detaching volume ee5f4840-0070-4498-bdae-b118ca081e5a
Nov 15 13:05:47 user nova-compute[75813]: INFO nova.virt.block_device [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Attempting to driver detach volume ee5f4840-0070-4498-bdae-b118ca081e5a from mountpoint /dev/vdb
Nov 15 13:05:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Attempting to detach device vdb from instance 9fed6377-0614-41ae-b421-75d74da5fa4f from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:05:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:05:47 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:05:47 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:05:47 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:05:47 user nova-compute[75813]:   <serial>ee5f4840-0070-4498-bdae-b118ca081e5a</serial>
Nov 15 13:05:47 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:05:47 user nova-compute[75813]: </disk>
Nov 15 13:05:47 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:05:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Successfully detached device vdb from instance 9fed6377-0614-41ae-b421-75d74da5fa4f from the persistent domain config.
Nov 15 13:05:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9fed6377-0614-41ae-b421-75d74da5fa4f from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:05:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:05:47 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:05:47 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:05:47 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:05:47 user nova-compute[75813]:   <serial>ee5f4840-0070-4498-bdae-b118ca081e5a</serial>
Nov 15 13:05:47 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:05:47 user nova-compute[75813]: </disk>
Nov 15 13:05:47 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:05:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:05:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:05:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:05:52 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:05:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:05:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:05:52 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:05:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:05:53 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updating instance_info_cache with network_info: [{"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:05:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:05:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:05:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:05:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:05:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:05:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:05:54 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:05:55 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:05:56 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:05:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:05:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:05:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:05:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:00 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:06:00 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:06:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8190MB free_disk=24.953441619873047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:06:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 9fed6377-0614-41ae-b421-75d74da5fa4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance b74022f2-55af-4eb7-81e0-4696fefd5ae5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca153542-ced0-4884-827f-7af9517b6d8a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "ca153542-ced0-4884-827f-7af9517b6d8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "ca153542-ced0-4884-827f-7af9517b6d8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.192s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:06:01 user nova-compute[75813]: INFO nova.compute.claims [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Claim successful on node user
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:06:01 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:06:01 user nova-compute[75813]: DEBUG nova.policy [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07f52b120c2e46e2a8ca7eb83dafceca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '134cc574095942efb38b85068bc72bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:06:02 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Creating image(s)
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "/opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "/opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk 1073741824" returned: 0 in 0.064s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Successfully created port: a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.209s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Cannot resize image /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Ensure instance console log exists: /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Successfully updated port: a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "refresh_cache-ca153542-ced0-4884-827f-7af9517b6d8a" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquired lock "refresh_cache-ca153542-ced0-4884-827f-7af9517b6d8a" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-cee129bb-1fb7-476a-82a5-658044fbdbbe req-3b3fa74d-b898-450d-80f3-853106f0c61a service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Received event network-changed-a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-cee129bb-1fb7-476a-82a5-658044fbdbbe req-3b3fa74d-b898-450d-80f3-853106f0c61a service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Refreshing instance network info cache due to event network-changed-a46e2aba-da03-4727-a2c5-90c8ad7f05ef. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cee129bb-1fb7-476a-82a5-658044fbdbbe req-3b3fa74d-b898-450d-80f3-853106f0c61a service nova] Acquiring lock "refresh_cache-ca153542-ced0-4884-827f-7af9517b6d8a" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Updating instance_info_cache with network_info: [{"id": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "address": "fa:16:3e:53:76:4d", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46e2aba-da", "ovs_interfaceid": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Releasing lock "refresh_cache-ca153542-ced0-4884-827f-7af9517b6d8a" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Instance network_info: |[{"id": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "address": "fa:16:3e:53:76:4d", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46e2aba-da", "ovs_interfaceid": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cee129bb-1fb7-476a-82a5-658044fbdbbe req-3b3fa74d-b898-450d-80f3-853106f0c61a service nova] Acquired lock "refresh_cache-ca153542-ced0-4884-827f-7af9517b6d8a" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-cee129bb-1fb7-476a-82a5-658044fbdbbe req-3b3fa74d-b898-450d-80f3-853106f0c61a service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Refreshing network info cache for port a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Start _get_guest_xml network_info=[{"id": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "address": "fa:16:3e:53:76:4d", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46e2aba-da", "ovs_interfaceid": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:06:03 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:06:03 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1185003820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1185003820',id=31,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-7uo4re8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:06:02Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=ca153542-ced0-4884-827f-7af9517b6d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "address": "fa:16:3e:53:76:4d", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46e2aba-da", "ovs_interfaceid": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "address": "fa:16:3e:53:76:4d", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46e2aba-da", "ovs_interfaceid": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:76:4d,bridge_name='br-int',has_traffic_filtering=True,id=a46e2aba-da03-4727-a2c5-90c8ad7f05ef,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46e2aba-da') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.objects.instance [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'pci_devices' on Instance uuid ca153542-ced0-4884-827f-7af9517b6d8a {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:06:03 user nova-compute[75813]:   <uuid>ca153542-ced0-4884-827f-7af9517b6d8a</uuid>
Nov 15 13:06:03 user nova-compute[75813]:   <name>instance-0000001f</name>
Nov 15 13:06:03 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:06:03 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:06:03 user nova-compute[75813]:   <metadata>
Nov 15 13:06:03 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:06:03 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:06:03 user nova-compute[75813]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1185003820</nova:name>
Nov 15 13:06:03 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:06:03</nova:creationTime>
Nov 15 13:06:03 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:06:03 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:06:03 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:06:03 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:06:03 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:06:03 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:06:03 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:06:03 user nova-compute[75813]:       <nova:owner>
Nov 15 13:06:03 user nova-compute[75813]:         <nova:user uuid="07f52b120c2e46e2a8ca7eb83dafceca">tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member</nova:user>
Nov 15 13:06:03 user nova-compute[75813]:         <nova:project uuid="134cc574095942efb38b85068bc72bfe">tempest-ServerBootFromVolumeStableRescueTest-2006280819</nova:project>
Nov 15 13:06:03 user nova-compute[75813]:       </nova:owner>
Nov 15 13:06:03 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:06:03 user nova-compute[75813]:       <nova:ports>
Nov 15 13:06:03 user nova-compute[75813]:         <nova:port uuid="a46e2aba-da03-4727-a2c5-90c8ad7f05ef">
Nov 15 13:06:03 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 13:06:03 user nova-compute[75813]:         </nova:port>
Nov 15 13:06:03 user nova-compute[75813]:       </nova:ports>
Nov 15 13:06:03 user nova-compute[75813]:     </nova:instance>
Nov 15 13:06:03 user nova-compute[75813]:   </metadata>
Nov 15 13:06:03 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:06:03 user nova-compute[75813]:     <system>
Nov 15 13:06:03 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:06:03 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:06:03 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:06:03 user nova-compute[75813]:       <entry name="serial">ca153542-ced0-4884-827f-7af9517b6d8a</entry>
Nov 15 13:06:03 user nova-compute[75813]:       <entry name="uuid">ca153542-ced0-4884-827f-7af9517b6d8a</entry>
Nov 15 13:06:03 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:06:03 user nova-compute[75813]:     </system>
Nov 15 13:06:03 user nova-compute[75813]:   </sysinfo>
Nov 15 13:06:03 user nova-compute[75813]:   <os>
Nov 15 13:06:03 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:06:03 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:06:03 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:06:03 user nova-compute[75813]:   </os>
Nov 15 13:06:03 user nova-compute[75813]:   <features>
Nov 15 13:06:03 user nova-compute[75813]:     <acpi/>
Nov 15 13:06:03 user nova-compute[75813]:     <apic/>
Nov 15 13:06:03 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:06:03 user nova-compute[75813]:   </features>
Nov 15 13:06:03 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:06:03 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:06:03 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:06:03 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:06:03 user nova-compute[75813]:   </clock>
Nov 15 13:06:03 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:06:03 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:06:03 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:06:03 user nova-compute[75813]:   </cpu>
Nov 15 13:06:03 user nova-compute[75813]:   <devices>
Nov 15 13:06:03 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:06:03 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:06:03 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk"/>
Nov 15 13:06:03 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:06:03 user nova-compute[75813]:     </disk>
Nov 15 13:06:03 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:06:03 user nova-compute[75813]:       <mac address="fa:16:3e:53:76:4d"/>
Nov 15 13:06:03 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:06:03 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:06:03 user nova-compute[75813]:       <target dev="tapa46e2aba-da"/>
Nov 15 13:06:03 user nova-compute[75813]:     </interface>
Nov 15 13:06:03 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:06:03 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/console.log" append="off"/>
Nov 15 13:06:03 user nova-compute[75813]:     </serial>
Nov 15 13:06:03 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:06:03 user nova-compute[75813]:     <video>
Nov 15 13:06:03 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:06:03 user nova-compute[75813]:     </video>
Nov 15 13:06:03 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:06:03 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:06:03 user nova-compute[75813]:     </rng>
Nov 15 13:06:03 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:06:03 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:06:03 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:06:03 user nova-compute[75813]:     </memballoon>
Nov 15 13:06:03 user nova-compute[75813]:   </devices>
Nov 15 13:06:03 user nova-compute[75813]: </domain>
Nov 15 13:06:03 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1185003820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1185003820',id=31,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-7uo4re8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:06:02Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=ca153542-ced0-4884-827f-7af9517b6d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "address": "fa:16:3e:53:76:4d", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46e2aba-da", "ovs_interfaceid": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "address": "fa:16:3e:53:76:4d", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46e2aba-da", "ovs_interfaceid": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:76:4d,bridge_name='br-int',has_traffic_filtering=True,id=a46e2aba-da03-4727-a2c5-90c8ad7f05ef,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46e2aba-da') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG os_vif [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:76:4d,bridge_name='br-int',has_traffic_filtering=True,id=a46e2aba-da03-4727-a2c5-90c8ad7f05ef,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46e2aba-da') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '043c8721-6d8d-5b63-a462-269212a34650', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa46e2aba-da, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa46e2aba-da, col_values=(('qos', UUID('93de73ea-6bbb-4fba-ac7f-72f89c0ce8a4')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa46e2aba-da, col_values=(('external_ids', {'iface-id': 'a46e2aba-da03-4727-a2c5-90c8ad7f05ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:76:4d', 'vm-uuid': 'ca153542-ced0-4884-827f-7af9517b6d8a'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:03 user nova-compute[75813]: INFO os_vif [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:76:4d,bridge_name='br-int',has_traffic_filtering=True,id=a46e2aba-da03-4727-a2c5-90c8ad7f05ef,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46e2aba-da')
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No VIF found with MAC fa:16:3e:53:76:4d, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-cee129bb-1fb7-476a-82a5-658044fbdbbe req-3b3fa74d-b898-450d-80f3-853106f0c61a service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Updated VIF entry in instance network info cache for port a46e2aba-da03-4727-a2c5-90c8ad7f05ef. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-cee129bb-1fb7-476a-82a5-658044fbdbbe req-3b3fa74d-b898-450d-80f3-853106f0c61a service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Updating instance_info_cache with network_info: [{"id": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "address": "fa:16:3e:53:76:4d", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46e2aba-da", "ovs_interfaceid": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:06:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cee129bb-1fb7-476a-82a5-658044fbdbbe req-3b3fa74d-b898-450d-80f3-853106f0c61a service nova] Releasing lock "refresh_cache-ca153542-ced0-4884-827f-7af9517b6d8a" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:06:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-31f2d6d0-7e5e-4ee7-ae43-b78ca813cbcf req-5532b3e5-2ca5-4c9f-b57b-456787adae70 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Received event network-vif-plugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-31f2d6d0-7e5e-4ee7-ae43-b78ca813cbcf req-5532b3e5-2ca5-4c9f-b57b-456787adae70 service nova] Acquiring lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-31f2d6d0-7e5e-4ee7-ae43-b78ca813cbcf req-5532b3e5-2ca5-4c9f-b57b-456787adae70 service nova] Lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-31f2d6d0-7e5e-4ee7-ae43-b78ca813cbcf req-5532b3e5-2ca5-4c9f-b57b-456787adae70 service nova] Lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-31f2d6d0-7e5e-4ee7-ae43-b78ca813cbcf req-5532b3e5-2ca5-4c9f-b57b-456787adae70 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] No waiting events found dispatching network-vif-plugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:06:05 user nova-compute[75813]: WARNING nova.compute.manager [req-31f2d6d0-7e5e-4ee7-ae43-b78ca813cbcf req-5532b3e5-2ca5-4c9f-b57b-456787adae70 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Received unexpected event network-vif-plugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef for instance with vm_state building and task_state spawning.
Nov 15 13:06:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:06:07 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Instance spawned successfully.
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:07 user nova-compute[75813]: INFO nova.compute.manager [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:06:07 user nova-compute[75813]: INFO nova.compute.manager [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Took 6.07 seconds to build instance.
Nov 15 13:06:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2d7b878c-202d-429e-afcd-a893a5432365 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "ca153542-ced0-4884-827f-7af9517b6d8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.184s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-cfa4b174-de47-4f23-bf6f-83f2b32b98f3 req-f43212b3-28ca-45ec-a36e-61cab4ab80a4 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Received event network-vif-plugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cfa4b174-de47-4f23-bf6f-83f2b32b98f3 req-f43212b3-28ca-45ec-a36e-61cab4ab80a4 service nova] Acquiring lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cfa4b174-de47-4f23-bf6f-83f2b32b98f3 req-f43212b3-28ca-45ec-a36e-61cab4ab80a4 service nova] Lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cfa4b174-de47-4f23-bf6f-83f2b32b98f3 req-f43212b3-28ca-45ec-a36e-61cab4ab80a4 service nova] Lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-cfa4b174-de47-4f23-bf6f-83f2b32b98f3 req-f43212b3-28ca-45ec-a36e-61cab4ab80a4 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] No waiting events found dispatching network-vif-plugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:06:07 user nova-compute[75813]: WARNING nova.compute.manager [req-cfa4b174-de47-4f23-bf6f-83f2b32b98f3 req-f43212b3-28ca-45ec-a36e-61cab4ab80a4 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Received unexpected event network-vif-plugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef for instance with vm_state active and task_state None.
Nov 15 13:06:08 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9fed6377-0614-41ae-b421-75d74da5fa4f is timed out.
Nov 15 13:06:08 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Successfully detached device vdb from instance 9fed6377-0614-41ae-b421-75d74da5fa4f from the live domain config.
Nov 15 13:06:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LzkjYOtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:06:08 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[23454c3f-b4e6-4d34-9995-538a6d3cb6fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:06:08 user nova-compute[75813]: No targets found.
Nov 15 13:06:08 user nova-compute[75813]: iSNS:
Nov 15 13:06:08 user nova-compute[75813]: No targets found.
Nov 15 13:06:08 user nova-compute[75813]: STATIC:
Nov 15 13:06:08 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:06:08 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:06:08 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:06:08 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd
Nov 15 13:06:08 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:06:08 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:06:08 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a
Nov 15 13:06:08 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:06:08 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:06:08 user nova-compute[75813]: FIRMWARE:
Nov 15 13:06:08 user nova-compute[75813]: No targets found.
Nov 15 13:06:08 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:06:08 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:06:08 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbf40a1-f3c3-4b9b-9d03-6ef09e7f741a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7f03f3-4008-42da-97f6-6b53097e2d7c]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:06:08 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:06:08 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:06:08 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:06:08 user nova-compute[75813]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a (non-flash)
Nov 15 13:06:08 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:06:08 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550148a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6d6266-d59c-4e62-99b7-68f5f6cb277e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[224e43f2-f0d1-4f04-885b-8d9f7315efe8]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0664ce-34a0-4f2f-b510-9ca9808f6951]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a1636c-a8c8-4f95-92e7-14ecd0337207]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[929d0f50-8503-4235-92c4-ea7cbc4c9d07]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aed77b-ad69-4910-a7b8-e37e28e332cd]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a, portal: 172.16.0.220,3260]
Nov 15 13:06:08 user nova-compute[75813]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a, portal: 172.16.0.220,3260] successful.
Nov 15 13:06:08 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f4840-0070-4498-bdae-b118ca081e5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73d2964-32b8-4a33-8bde-d134f26e0ba3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] <== disconnect_volume: return (334ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:06:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:06:09 user nova-compute[75813]: DEBUG nova.objects.instance [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'flavor' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:06:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9992f525-b89f-4f71-b40a-0e8f8937a1e4 tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.656s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:06:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:06:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:06:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:06:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:06:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:06:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:06:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:06:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:06:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:30 user nova-compute[75813]: DEBUG nova.compute.manager [req-538dea73-aa66-48d7-abd4-7ea7af674802 req-07ab86fc-36c3-423b-8a4a-0513400db6ec service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-changed-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:30 user nova-compute[75813]: DEBUG nova.compute.manager [req-538dea73-aa66-48d7-abd4-7ea7af674802 req-07ab86fc-36c3-423b-8a4a-0513400db6ec service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Refreshing instance network info cache due to event network-changed-76c7059b-cb68-4832-940f-9832e339c26c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:06:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-538dea73-aa66-48d7-abd4-7ea7af674802 req-07ab86fc-36c3-423b-8a4a-0513400db6ec service nova] Acquiring lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:06:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-538dea73-aa66-48d7-abd4-7ea7af674802 req-07ab86fc-36c3-423b-8a4a-0513400db6ec service nova] Acquired lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:06:30 user nova-compute[75813]: DEBUG nova.network.neutron [req-538dea73-aa66-48d7-abd4-7ea7af674802 req-07ab86fc-36c3-423b-8a4a-0513400db6ec service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Refreshing network info cache for port 76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:06:31 user nova-compute[75813]: DEBUG nova.network.neutron [req-538dea73-aa66-48d7-abd4-7ea7af674802 req-07ab86fc-36c3-423b-8a4a-0513400db6ec service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Updated VIF entry in instance network info cache for port 76c7059b-cb68-4832-940f-9832e339c26c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:06:31 user nova-compute[75813]: DEBUG nova.network.neutron [req-538dea73-aa66-48d7-abd4-7ea7af674802 req-07ab86fc-36c3-423b-8a4a-0513400db6ec service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Updating instance_info_cache with network_info: [{"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:06:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-538dea73-aa66-48d7-abd4-7ea7af674802 req-07ab86fc-36c3-423b-8a4a-0513400db6ec service nova] Releasing lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:06:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.003s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:33 user nova-compute[75813]: INFO nova.compute.manager [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Shelving
Nov 15 13:06:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:34 user nova-compute[75813]: INFO nova.compute.manager [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Detaching volume 2e70b809-480b-4c14-a446-538c1975eedd
Nov 15 13:06:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-0a4364bf-31cb-463a-bddc-d228c4a19bf4 req-172b3a63-1d00-4d6a-b3ef-6838258fd040 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-unplugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0a4364bf-31cb-463a-bddc-d228c4a19bf4 req-172b3a63-1d00-4d6a-b3ef-6838258fd040 service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0a4364bf-31cb-463a-bddc-d228c4a19bf4 req-172b3a63-1d00-4d6a-b3ef-6838258fd040 service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0a4364bf-31cb-463a-bddc-d228c4a19bf4 req-172b3a63-1d00-4d6a-b3ef-6838258fd040 service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-0a4364bf-31cb-463a-bddc-d228c4a19bf4 req-172b3a63-1d00-4d6a-b3ef-6838258fd040 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-unplugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:06:34 user nova-compute[75813]: WARNING nova.compute.manager [req-0a4364bf-31cb-463a-bddc-d228c4a19bf4 req-172b3a63-1d00-4d6a-b3ef-6838258fd040 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received unexpected event network-vif-unplugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with vm_state active and task_state shelving.
Nov 15 13:06:34 user nova-compute[75813]: INFO nova.virt.block_device [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Attempting to driver detach volume 2e70b809-480b-4c14-a446-538c1975eedd from mountpoint /dev/vdb
Nov 15 13:06:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Attempting to detach device vdb from instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:06:34 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:06:34 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 13:06:34 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:06:34 user nova-compute[75813]:   <serial>2e70b809-480b-4c14-a446-538c1975eedd</serial>
Nov 15 13:06:34 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 13:06:34 user nova-compute[75813]: </disk>
Nov 15 13:06:34 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:06:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully detached device vdb from instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 from the persistent domain config.
Nov 15 13:06:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:06:34 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:06:34 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 13:06:34 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:06:34 user nova-compute[75813]:   <serial>2e70b809-480b-4c14-a446-538c1975eedd</serial>
Nov 15 13:06:34 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 13:06:34 user nova-compute[75813]: </disk>
Nov 15 13:06:34 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:06:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:06:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Instance destroyed successfully.
Nov 15 13:06:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Beginning cold snapshot process
Nov 15 13:06:35 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:06:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk /opt/stack/data/nova/instances/snapshots/tmp4fwmnwal/68551565be7d4461954fc913b8bbb14f {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk /opt/stack/data/nova/instances/snapshots/tmp4fwmnwal/68551565be7d4461954fc913b8bbb14f" returned: 0 in 0.468s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:35 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Snapshot extracted, beginning image upload
Nov 15 13:06:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:36 user nova-compute[75813]: DEBUG nova.compute.manager [req-18327bfc-aae6-45b5-8272-ed891856a1a3 req-b940c2a8-44a4-4042-9aa0-819a0169e201 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-18327bfc-aae6-45b5-8272-ed891856a1a3 req-b940c2a8-44a4-4042-9aa0-819a0169e201 service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-18327bfc-aae6-45b5-8272-ed891856a1a3 req-b940c2a8-44a4-4042-9aa0-819a0169e201 service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-18327bfc-aae6-45b5-8272-ed891856a1a3 req-b940c2a8-44a4-4042-9aa0-819a0169e201 service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:36 user nova-compute[75813]: DEBUG nova.compute.manager [req-18327bfc-aae6-45b5-8272-ed891856a1a3 req-b940c2a8-44a4-4042-9aa0-819a0169e201 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:06:36 user nova-compute[75813]: WARNING nova.compute.manager [req-18327bfc-aae6-45b5-8272-ed891856a1a3 req-b940c2a8-44a4-4042-9aa0-819a0169e201 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received unexpected event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 13:06:37 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Snapshot image upload complete
Nov 15 13:06:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:06:38 user nova-compute[75813]: INFO nova.compute.manager [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Shelve offloading
Nov 15 13:06:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Instance destroyed successfully.
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquired lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:06:38 user nova-compute[75813]: INFO nova.compute.claims [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Claim successful on node user
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:38 user nova-compute[75813]: INFO nova.compute.manager [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Terminating instance
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Updating instance_info_cache with network_info: [{"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Releasing lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-15b15136-b2b1-4b5b-8e0e-2bf043307114 req-a542e332-0f92-4c09-b33b-e059a881fe10 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-unplugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-15b15136-b2b1-4b5b-8e0e-2bf043307114 req-a542e332-0f92-4c09-b33b-e059a881fe10 service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-15b15136-b2b1-4b5b-8e0e-2bf043307114 req-a542e332-0f92-4c09-b33b-e059a881fe10 service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-15b15136-b2b1-4b5b-8e0e-2bf043307114 req-a542e332-0f92-4c09-b33b-e059a881fe10 service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-15b15136-b2b1-4b5b-8e0e-2bf043307114 req-a542e332-0f92-4c09-b33b-e059a881fe10 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-unplugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-15b15136-b2b1-4b5b-8e0e-2bf043307114 req-a542e332-0f92-4c09-b33b-e059a881fe10 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-unplugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:06:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:06:38 user nova-compute[75813]: DEBUG nova.policy [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bc41f21cddc40e7a287b6f809233a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63086918b1c84a608c4a5aebf968eab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:06:38 user nova-compute[75813]: INFO nova.virt.block_device [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Booting with volume d1c34bea-a258-4fb0-8960-20f8cb6c15c7 at /dev/vda
Nov 15 13:06:39 user nova-compute[75813]: DEBUG os_brick.utils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b5b847-dad1-4d58-95cb-bd7d95dcec19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[880ae61e-8cea-4e0f-800d-6d544bc8b616]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1409c42-13fd-40a0-ab4d-9e8cd94bffa2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de1a01-ef62-4707-a82a-dd3fbcad49b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:06:39 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e90a6f-7fd0-4295-ae03-1ccb7a0fe2ff]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG os_brick.utils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Updating existing volume attachment record: 87d819e8-ffdc-48ae-9c32-863e9a008868 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:06:39 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Instance destroyed successfully.
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.objects.instance [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lazy-loading 'resources' on Instance uuid 9fed6377-0614-41ae-b421-75d74da5fa4f {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-769032625',display_name='tempest-ServerStableDeviceRescueTest-server-769032625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-769032625',id=26,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzzk9jkYa2qK3g2qHA80X2IIlCEvYNVQHBu3MXjtij+IveyI/kQM+mfPmI4bzYJMNgOrabk3d96/29iEiC5VLn8uVpUX8YHFyrCAmQw348M8B4eJlyJR5go7pI8xa1dXA==',key_name='tempest-keypair-1027890915',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:03:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64457e74254e47b6845be2aef4de8206',ramdisk_id='',reservation_id='r-ae33rltr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-344856713',owner_user_name='tempest-ServerStableDeviceRescueTest-344856713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:05:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63700cf0bb0044a59c71f38fe702e812',uuid=9fed6377-0614-41ae-b421-75d74da5fa4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Converting VIF {"id": "0855cbc5-0088-42fb-be12-422784a52b93", "address": "fa:16:3e:51:f9:c7", "network": {"id": "87e7af6f-5cca-4d1f-8c4d-8763e71bfa17", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1567085058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64457e74254e47b6845be2aef4de8206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0855cbc5-00", "ovs_interfaceid": "0855cbc5-0088-42fb-be12-422784a52b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:f9:c7,bridge_name='br-int',has_traffic_filtering=True,id=0855cbc5-0088-42fb-be12-422784a52b93,network=Network(87e7af6f-5cca-4d1f-8c4d-8763e71bfa17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0855cbc5-00') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG os_vif [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:f9:c7,bridge_name='br-int',has_traffic_filtering=True,id=0855cbc5-0088-42fb-be12-422784a52b93,network=Network(87e7af6f-5cca-4d1f-8c4d-8763e71bfa17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0855cbc5-00') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0855cbc5-00, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30d92025-5e51-4102-b798-765fe3c66d5d) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:39 user nova-compute[75813]: INFO os_vif [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:f9:c7,bridge_name='br-int',has_traffic_filtering=True,id=0855cbc5-0088-42fb-be12-422784a52b93,network=Network(87e7af6f-5cca-4d1f-8c4d-8763e71bfa17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0855cbc5-00')
Nov 15 13:06:39 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Deleting instance files /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f_del
Nov 15 13:06:39 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Deletion of /opt/stack/data/nova/instances/9fed6377-0614-41ae-b421-75d74da5fa4f_del complete
Nov 15 13:06:39 user nova-compute[75813]: INFO nova.compute.manager [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:06:39 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Instance destroyed successfully.
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.objects.instance [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'resources' on Instance uuid b74022f2-55af-4eb7-81e0-4696fefd5ae5 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-781384000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-781384000',id=30,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkUDCIMVpwJ2r5TfPwzRES7t2GVPpTHPcXaXt0ic3Rfm82sQfAAbf7CBQlEcYuXdL5tZfjX3t098yw/VS91DddIz1diZsymHOmYVBXCjVDBeI8TxiFp73nljQa0QLd50g==',key_name='tempest-keypair-1610888735',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-5d7gag7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member',shelved_at='2023-11-15T13:06:37.994323',shelved_host='user',shelved_image_id='babe3620-24a1-4456-8164-4260c8414163'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:06:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=b74022f2-55af-4eb7-81e0-4696fefd5ae5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG os_vif [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76c7059b-cb, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46d67686-5f77-4822-9ffe-6bfc7930876b) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:06:39 user nova-compute[75813]: INFO os_vif [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb')
Nov 15 13:06:39 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Deleting instance files /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5_del
Nov 15 13:06:39 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Deletion of /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5_del complete
Nov 15 13:06:39 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Deleted allocations for instance b74022f2-55af-4eb7-81e0-4696fefd5ae5
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.objects.instance [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'numa_topology' on Instance uuid b74022f2-55af-4eb7-81e0-4696fefd5ae5 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.objects.base [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Object Instance<b74022f2-55af-4eb7-81e0-4696fefd5ae5> lazy-loaded attributes: resources,numa_topology {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:06:39 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:06:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:40 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Successfully created port: c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:06:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2b113e9d-fa5d-4c9b-875d-0a67d1a8d883 tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.083s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-71cdbb9b-bc14-40c3-80b9-4ac38f85ca6b req-7cc2a204-e9b6-4b6c-a9b7-308f3105945a service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-71cdbb9b-bc14-40c3-80b9-4ac38f85ca6b req-7cc2a204-e9b6-4b6c-a9b7-308f3105945a service nova] Acquiring lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-71cdbb9b-bc14-40c3-80b9-4ac38f85ca6b req-7cc2a204-e9b6-4b6c-a9b7-308f3105945a service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-71cdbb9b-bc14-40c3-80b9-4ac38f85ca6b req-7cc2a204-e9b6-4b6c-a9b7-308f3105945a service nova] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-71cdbb9b-bc14-40c3-80b9-4ac38f85ca6b req-7cc2a204-e9b6-4b6c-a9b7-308f3105945a service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] No waiting events found dispatching network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:06:40 user nova-compute[75813]: WARNING nova.compute.manager [req-71cdbb9b-bc14-40c3-80b9-4ac38f85ca6b req-7cc2a204-e9b6-4b6c-a9b7-308f3105945a service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received unexpected event network-vif-plugged-0855cbc5-0088-42fb-be12-422784a52b93 for instance with vm_state active and task_state deleting.
Nov 15 13:06:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:06:41 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Took 1.92 seconds to deallocate network for instance.
Nov 15 13:06:41 user nova-compute[75813]: DEBUG nova.compute.manager [req-07dfbd23-e222-4244-8c09-aafac70bd1c8 req-6bd984df-b45a-424e-8bbb-bd158eeb4516 service nova] [instance: 9fed6377-0614-41ae-b421-75d74da5fa4f] Received event network-vif-deleted-0855cbc5-0088-42fb-be12-422784a52b93 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Successfully updated port: c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "refresh_cache-3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquired lock "refresh_cache-3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:41 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Deleted allocations for instance 9fed6377-0614-41ae-b421-75d74da5fa4f
Nov 15 13:06:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-21f3ad30-cf16-4055-89fc-ec262a85c56b tempest-ServerStableDeviceRescueTest-344856713 tempest-ServerStableDeviceRescueTest-344856713-project-member] Lock "9fed6377-0614-41ae-b421-75d74da5fa4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.380s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Updating instance_info_cache with network_info: [{"id": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "address": "fa:16:3e:49:23:51", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64a9689-ab", "ovs_interfaceid": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Releasing lock "refresh_cache-3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:06:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Instance network_info: |[{"id": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "address": "fa:16:3e:49:23:51", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64a9689-ab", "ovs_interfaceid": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:06:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-ba2fd14d-6429-4eb4-83e1-952edd69e84e req-fc52f56f-4b02-46ac-8fec-cfc6ed29ac95 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Received event network-changed-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-ba2fd14d-6429-4eb4-83e1-952edd69e84e req-fc52f56f-4b02-46ac-8fec-cfc6ed29ac95 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Refreshing instance network info cache due to event network-changed-c64a9689-ab31-4330-8a2b-02bb3ed8aba3. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:06:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ba2fd14d-6429-4eb4-83e1-952edd69e84e req-fc52f56f-4b02-46ac-8fec-cfc6ed29ac95 service nova] Acquiring lock "refresh_cache-3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:06:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ba2fd14d-6429-4eb4-83e1-952edd69e84e req-fc52f56f-4b02-46ac-8fec-cfc6ed29ac95 service nova] Acquired lock "refresh_cache-3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:06:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-ba2fd14d-6429-4eb4-83e1-952edd69e84e req-fc52f56f-4b02-46ac-8fec-cfc6ed29ac95 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Refreshing network info cache for port c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:06:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-ba2fd14d-6429-4eb4-83e1-952edd69e84e req-fc52f56f-4b02-46ac-8fec-cfc6ed29ac95 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Updated VIF entry in instance network info cache for port c64a9689-ab31-4330-8a2b-02bb3ed8aba3. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:06:43 user nova-compute[75813]: DEBUG nova.network.neutron [req-ba2fd14d-6429-4eb4-83e1-952edd69e84e req-fc52f56f-4b02-46ac-8fec-cfc6ed29ac95 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Updating instance_info_cache with network_info: [{"id": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "address": "fa:16:3e:49:23:51", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64a9689-ab", "ovs_interfaceid": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:06:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ba2fd14d-6429-4eb4-83e1-952edd69e84e req-fc52f56f-4b02-46ac-8fec-cfc6ed29ac95 service nova] Releasing lock "refresh_cache-3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:06:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Creating image(s)
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Ensure instance console log exists: /opt/stack/data/nova/instances/3a6627d2-9dee-4591-9020-bd0d7ba9b9d6/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Start _get_guest_xml network_info=[{"id": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "address": "fa:16:3e:49:23:51", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64a9689-ab", "ovs_interfaceid": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '87d819e8-ffdc-48ae-9c32-863e9a008868', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZuEOBDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a6627d2-9dee-4591-9020-bd0d7ba9b9d6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1c34bea-a258-4fb0-8960-20f8cb6c15c7', 'serial': 'd1c34bea-a258-4fb0-8960-20f8cb6c15c7'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:06:44 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:06:44 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZuEOBDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:06:44 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:06:44 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:06:44 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d35b4b-d60b-4377-84f3-bdb932c6c00e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:06:44 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[812ae128-bd8e-4807-9bde-6154329d34ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7] added
Nov 15 13:06:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1f5521-fe0b-41c4-925b-932bfc70babd]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[46472f3e-2e80-4952-8f68-0398f089d45f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SZuEOBDc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SZuEOBDc" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[30140f9e-d4b9-428e-9e62-fd9dd7c3a8c1]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SZuEOBDc'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf4efad-01b9-4ed8-aabd-542705eee421]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[128b3758-6e0b-4f8f-991e-6eed613ace42]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:06:44 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:06:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:06:44 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:06:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d2ce07-07de-40dd-8c74-01c3c4672a24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7, portal: 172.16.0.220,3260]
Nov 15 13:06:44 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7, portal: 172.16.0.220,3260] successful.
Nov 15 13:06:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[85be4341-c708-4907-8b43-a01206f80781]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60da8f4-d2f4-4e29-a047-a6686d79777f]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:06:44 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:06:44 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:06:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:06:44 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:06:44 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:06:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4705ec69-3122-4396-85be-e79345840e95]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZuEOBDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:06:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23431373332373335', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431373332373335', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1890619950',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1890619950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1890619950',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCANFGsyGP+5VanSh73vYgMZ/zkoqlXTP6uW67dnVAvWotvt8kOLrmLFptTAoFniPH3wkiq9eIiOKkGuTSlXsp9jHrwJYJBzeAI9RgKW0UWwc4+3q92L9C9TGU0dt1kHfQ==',key_name='tempest-keypair-1298991320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-pmqtsobf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=3a6627d2-9dee-4591-9020-bd0d7ba9b9d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "address": "fa:16:3e:49:23:51", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64a9689-ab", "ovs_interfaceid": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "address": "fa:16:3e:49:23:51", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64a9689-ab", "ovs_interfaceid": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:51,bridge_name='br-int',has_traffic_filtering=True,id=c64a9689-ab31-4330-8a2b-02bb3ed8aba3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64a9689-ab') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG nova.objects.instance [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:06:45 user nova-compute[75813]:   <uuid>3a6627d2-9dee-4591-9020-bd0d7ba9b9d6</uuid>
Nov 15 13:06:45 user nova-compute[75813]:   <name>instance-00000020</name>
Nov 15 13:06:45 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:06:45 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:06:45 user nova-compute[75813]:   <metadata>
Nov 15 13:06:45 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:06:45 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:06:45 user nova-compute[75813]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1890619950</nova:name>
Nov 15 13:06:45 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:06:44</nova:creationTime>
Nov 15 13:06:45 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:06:45 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:06:45 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:06:45 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:06:45 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:06:45 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:06:45 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:06:45 user nova-compute[75813]:       <nova:owner>
Nov 15 13:06:45 user nova-compute[75813]:         <nova:user uuid="3bc41f21cddc40e7a287b6f809233a65">tempest-TestVolumeBootPattern-678819035-project-member</nova:user>
Nov 15 13:06:45 user nova-compute[75813]:         <nova:project uuid="63086918b1c84a608c4a5aebf968eab5">tempest-TestVolumeBootPattern-678819035</nova:project>
Nov 15 13:06:45 user nova-compute[75813]:       </nova:owner>
Nov 15 13:06:45 user nova-compute[75813]:       <nova:ports>
Nov 15 13:06:45 user nova-compute[75813]:         <nova:port uuid="c64a9689-ab31-4330-8a2b-02bb3ed8aba3">
Nov 15 13:06:45 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 13:06:45 user nova-compute[75813]:         </nova:port>
Nov 15 13:06:45 user nova-compute[75813]:       </nova:ports>
Nov 15 13:06:45 user nova-compute[75813]:     </nova:instance>
Nov 15 13:06:45 user nova-compute[75813]:   </metadata>
Nov 15 13:06:45 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:06:45 user nova-compute[75813]:     <system>
Nov 15 13:06:45 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:06:45 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:06:45 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:06:45 user nova-compute[75813]:       <entry name="serial">3a6627d2-9dee-4591-9020-bd0d7ba9b9d6</entry>
Nov 15 13:06:45 user nova-compute[75813]:       <entry name="uuid">3a6627d2-9dee-4591-9020-bd0d7ba9b9d6</entry>
Nov 15 13:06:45 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:06:45 user nova-compute[75813]:     </system>
Nov 15 13:06:45 user nova-compute[75813]:   </sysinfo>
Nov 15 13:06:45 user nova-compute[75813]:   <os>
Nov 15 13:06:45 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:06:45 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:06:45 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:06:45 user nova-compute[75813]:   </os>
Nov 15 13:06:45 user nova-compute[75813]:   <features>
Nov 15 13:06:45 user nova-compute[75813]:     <acpi/>
Nov 15 13:06:45 user nova-compute[75813]:     <apic/>
Nov 15 13:06:45 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:06:45 user nova-compute[75813]:   </features>
Nov 15 13:06:45 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:06:45 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:06:45 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:06:45 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:06:45 user nova-compute[75813]:   </clock>
Nov 15 13:06:45 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:06:45 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:06:45 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:06:45 user nova-compute[75813]:   </cpu>
Nov 15 13:06:45 user nova-compute[75813]:   <devices>
Nov 15 13:06:45 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:06:45 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:06:45 user nova-compute[75813]:       <source dev="/dev/sdb"/>
Nov 15 13:06:45 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:06:45 user nova-compute[75813]:       <serial>d1c34bea-a258-4fb0-8960-20f8cb6c15c7</serial>
Nov 15 13:06:45 user nova-compute[75813]:     </disk>
Nov 15 13:06:45 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:06:45 user nova-compute[75813]:       <mac address="fa:16:3e:49:23:51"/>
Nov 15 13:06:45 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:06:45 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:06:45 user nova-compute[75813]:       <target dev="tapc64a9689-ab"/>
Nov 15 13:06:45 user nova-compute[75813]:     </interface>
Nov 15 13:06:45 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:06:45 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/3a6627d2-9dee-4591-9020-bd0d7ba9b9d6/console.log" append="off"/>
Nov 15 13:06:45 user nova-compute[75813]:     </serial>
Nov 15 13:06:45 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:06:45 user nova-compute[75813]:     <video>
Nov 15 13:06:45 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:06:45 user nova-compute[75813]:     </video>
Nov 15 13:06:45 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:06:45 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:06:45 user nova-compute[75813]:     </rng>
Nov 15 13:06:45 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:06:45 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:06:45 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:06:45 user nova-compute[75813]:     </memballoon>
Nov 15 13:06:45 user nova-compute[75813]:   </devices>
Nov 15 13:06:45 user nova-compute[75813]: </domain>
Nov 15 13:06:45 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1890619950',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1890619950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1890619950',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCANFGsyGP+5VanSh73vYgMZ/zkoqlXTP6uW67dnVAvWotvt8kOLrmLFptTAoFniPH3wkiq9eIiOKkGuTSlXsp9jHrwJYJBzeAI9RgKW0UWwc4+3q92L9C9TGU0dt1kHfQ==',key_name='tempest-keypair-1298991320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-pmqtsobf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=3a6627d2-9dee-4591-9020-bd0d7ba9b9d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "address": "fa:16:3e:49:23:51", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64a9689-ab", "ovs_interfaceid": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "address": "fa:16:3e:49:23:51", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64a9689-ab", "ovs_interfaceid": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:51,bridge_name='br-int',has_traffic_filtering=True,id=c64a9689-ab31-4330-8a2b-02bb3ed8aba3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64a9689-ab') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG os_vif [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:51,bridge_name='br-int',has_traffic_filtering=True,id=c64a9689-ab31-4330-8a2b-02bb3ed8aba3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64a9689-ab') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84acdcb1-596f-527d-a60f-7825aa58622e', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc64a9689-ab, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc64a9689-ab, col_values=(('qos', UUID('3c22f9c4-1660-4299-964a-434a686df4e8')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc64a9689-ab, col_values=(('external_ids', {'iface-id': 'c64a9689-ab31-4330-8a2b-02bb3ed8aba3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:23:51', 'vm-uuid': '3a6627d2-9dee-4591-9020-bd0d7ba9b9d6'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:45 user nova-compute[75813]: INFO os_vif [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:51,bridge_name='br-int',has_traffic_filtering=True,id=c64a9689-ab31-4330-8a2b-02bb3ed8aba3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64a9689-ab')
Nov 15 13:06:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:06:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No VIF found with MAC fa:16:3e:49:23:51, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:06:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-466bafbb-35c1-4b64-98f4-1c39b1e9b8f2 req-a579a176-958e-4228-b0b4-dbaa19a16f44 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Received event network-vif-plugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-466bafbb-35c1-4b64-98f4-1c39b1e9b8f2 req-a579a176-958e-4228-b0b4-dbaa19a16f44 service nova] Acquiring lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-466bafbb-35c1-4b64-98f4-1c39b1e9b8f2 req-a579a176-958e-4228-b0b4-dbaa19a16f44 service nova] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-466bafbb-35c1-4b64-98f4-1c39b1e9b8f2 req-a579a176-958e-4228-b0b4-dbaa19a16f44 service nova] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-466bafbb-35c1-4b64-98f4-1c39b1e9b8f2 req-a579a176-958e-4228-b0b4-dbaa19a16f44 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] No waiting events found dispatching network-vif-plugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:06:47 user nova-compute[75813]: WARNING nova.compute.manager [req-466bafbb-35c1-4b64-98f4-1c39b1e9b8f2 req-a579a176-958e-4228-b0b4-dbaa19a16f44 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Received unexpected event network-vif-plugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 for instance with vm_state building and task_state spawning.
Nov 15 13:06:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:06:49 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Instance spawned successfully.
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:06:49 user nova-compute[75813]: INFO nova.compute.manager [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-5220f4f2-46b4-4f59-8751-cc22d58528dd req-4cee6555-7825-45da-84a8-b57c4b797e99 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Received event network-vif-plugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5220f4f2-46b4-4f59-8751-cc22d58528dd req-4cee6555-7825-45da-84a8-b57c4b797e99 service nova] Acquiring lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5220f4f2-46b4-4f59-8751-cc22d58528dd req-4cee6555-7825-45da-84a8-b57c4b797e99 service nova] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5220f4f2-46b4-4f59-8751-cc22d58528dd req-4cee6555-7825-45da-84a8-b57c4b797e99 service nova] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-5220f4f2-46b4-4f59-8751-cc22d58528dd req-4cee6555-7825-45da-84a8-b57c4b797e99 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] No waiting events found dispatching network-vif-plugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:06:49 user nova-compute[75813]: WARNING nova.compute.manager [req-5220f4f2-46b4-4f59-8751-cc22d58528dd req-4cee6555-7825-45da-84a8-b57c4b797e99 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Received unexpected event network-vif-plugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 for instance with vm_state building and task_state spawning.
Nov 15 13:06:49 user nova-compute[75813]: INFO nova.compute.manager [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Took 10.84 seconds to build instance.
Nov 15 13:06:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0ab4d316-41db-4561-b69e-ae254bc28ed8 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.938s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:49 user nova-compute[75813]: INFO nova.compute.manager [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Terminating instance
Nov 15 13:06:49 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:06:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-b4b93d6d-ca66-48f6-90d9-ac8191f9ff62 req-38c6f880-43d0-4c0b-8ae7-d4154d200514 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-unplugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b4b93d6d-ca66-48f6-90d9-ac8191f9ff62 req-38c6f880-43d0-4c0b-8ae7-d4154d200514 service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b4b93d6d-ca66-48f6-90d9-ac8191f9ff62 req-38c6f880-43d0-4c0b-8ae7-d4154d200514 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b4b93d6d-ca66-48f6-90d9-ac8191f9ff62 req-38c6f880-43d0-4c0b-8ae7-d4154d200514 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-b4b93d6d-ca66-48f6-90d9-ac8191f9ff62 req-38c6f880-43d0-4c0b-8ae7-d4154d200514 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-unplugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-b4b93d6d-ca66-48f6-90d9-ac8191f9ff62 req-38c6f880-43d0-4c0b-8ae7-d4154d200514 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-unplugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:50 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Instance destroyed successfully.
Nov 15 13:06:50 user nova-compute[75813]: DEBUG nova.objects.instance [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'resources' on Instance uuid 525b3797-8d57-4bff-8ad9-4d53a8beaea4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1560614732',display_name='tempest-AttachVolumeTestJSON-server-1560614732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1560614732',id=21,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnbNba04CbeL7eAssBt/FmQ/iYfKbd5Suudux+Uq/+hDAu0UbaSznFUIXj3nEyetGtTpXd7+WYrSD1d+9oe6ooGQlSFefp1/qlmhmSqQ0sJ7qT77xL5D4H51OLc73q6+w==',key_name='tempest-keypair-1745276063',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-8n5drqmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=525b3797-8d57-4bff-8ad9-4d53a8beaea4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "address": "fa:16:3e:2f:03:54", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8472db86-c1", "ovs_interfaceid": "8472db86-c1ef-4c6a-a878-5951fa94e2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG os_vif [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8472db86-c1, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=acdc4ed4-6771-4de8-b083-4db2c7b449a5) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:50 user nova-compute[75813]: INFO os_vif [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:03:54,bridge_name='br-int',has_traffic_filtering=True,id=8472db86-c1ef-4c6a-a878-5951fa94e2e1,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8472db86-c1')
Nov 15 13:06:50 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Deleting instance files /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4_del
Nov 15 13:06:50 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Deletion of /opt/stack/data/nova/instances/525b3797-8d57-4bff-8ad9-4d53a8beaea4_del complete
Nov 15 13:06:50 user nova-compute[75813]: INFO nova.compute.manager [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 13:06:50 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:06:50 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:06:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:51 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:06:51 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Took 0.75 seconds to deallocate network for instance.
Nov 15 13:06:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-a2160c97-5c6c-40ac-8639-4dfb309e0e93 req-761800ca-4f4f-4222-a433-129f0a9c2f6b service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-deleted-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:51 user nova-compute[75813]: INFO nova.compute.manager [req-a2160c97-5c6c-40ac-8639-4dfb309e0e93 req-761800ca-4f4f-4222-a433-129f0a9c2f6b service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Neutron deleted interface 8472db86-c1ef-4c6a-a878-5951fa94e2e1; detaching it from the instance and deleting it from the info cache
Nov 15 13:06:51 user nova-compute[75813]: DEBUG nova.network.neutron [req-a2160c97-5c6c-40ac-8639-4dfb309e0e93 req-761800ca-4f4f-4222-a433-129f0a9c2f6b service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:06:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-a2160c97-5c6c-40ac-8639-4dfb309e0e93 req-761800ca-4f4f-4222-a433-129f0a9c2f6b service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Detach interface failed, port_id=8472db86-c1ef-4c6a-a878-5951fa94e2e1, reason: Instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4 could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 13:06:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:51 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:06:51 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:06:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:51 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Deleted allocations for instance 525b3797-8d57-4bff-8ad9-4d53a8beaea4
Nov 15 13:06:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6bcdf639-9e70-4259-a388-3dd8676f8f29 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-e22b587d-d77c-4398-94b6-899d77aaefa2 req-d9ee8626-3cba-4fd9-bcc2-d147d68b06c6 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:06:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e22b587d-d77c-4398-94b6-899d77aaefa2 req-d9ee8626-3cba-4fd9-bcc2-d147d68b06c6 service nova] Acquiring lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e22b587d-d77c-4398-94b6-899d77aaefa2 req-d9ee8626-3cba-4fd9-bcc2-d147d68b06c6 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e22b587d-d77c-4398-94b6-899d77aaefa2 req-d9ee8626-3cba-4fd9-bcc2-d147d68b06c6 service nova] Lock "525b3797-8d57-4bff-8ad9-4d53a8beaea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-e22b587d-d77c-4398-94b6-899d77aaefa2 req-d9ee8626-3cba-4fd9-bcc2-d147d68b06c6 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] No waiting events found dispatching network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:06:52 user nova-compute[75813]: WARNING nova.compute.manager [req-e22b587d-d77c-4398-94b6-899d77aaefa2 req-d9ee8626-3cba-4fd9-bcc2-d147d68b06c6 service nova] [instance: 525b3797-8d57-4bff-8ad9-4d53a8beaea4] Received unexpected event network-vif-plugged-8472db86-c1ef-4c6a-a878-5951fa94e2e1 for instance with vm_state deleted and task_state None.
Nov 15 13:06:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:06:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:06:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 13:06:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:06:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:06:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:06:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:06:54 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 is timed out.
Nov 15 13:06:54 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully detached device vdb from instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 from the live domain config.
Nov 15 13:06:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKOwYxZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:06:54 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0a5a4f-2234-4430-8d8e-ef7644f19ef5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:06:54 user nova-compute[75813]: No targets found.
Nov 15 13:06:54 user nova-compute[75813]: iSNS:
Nov 15 13:06:54 user nova-compute[75813]: No targets found.
Nov 15 13:06:54 user nova-compute[75813]: STATIC:
Nov 15 13:06:54 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:06:54 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:06:54 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:06:54 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd
Nov 15 13:06:54 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:06:54 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:06:54 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7
Nov 15 13:06:54 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:06:54 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:06:54 user nova-compute[75813]: FIRMWARE:
Nov 15 13:06:54 user nova-compute[75813]: No targets found.
Nov 15 13:06:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:06:54 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:06:54 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac340cd-09f4-4bd4-b8d2-ce7349960a45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaaa089-8821-44b4-bb1f-438af9790bf0]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:06:54 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:06:54 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:06:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:06:54 user nova-compute[75813]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd (non-flash)
Nov 15 13:06:54 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:06:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555042e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd'): ({'sdd'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Removing single pathed devices sdd {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f16378b-bfd9-49f5-a2d9-2a2683d2b549]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f88b39-6711-4541-a0b3-16dcd5074486]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flushing IO for device /dev/sdd {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6cbe8b-e679-4cb5-abff-6da3a591f782]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:06:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[58da3455-fa98-4a87-b5e3-ab3aaa4727f1]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1577fd-faa9-4d16-9200-010b753b8d97]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b9c5ae-4828-455d-aef5-bff41ca3f51a]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260]
Nov 15 13:06:55 user nova-compute[75813]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd, portal: 172.16.0.220,3260] successful.
Nov 15 13:06:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e70b809-480b-4c14-a446-538c1975eedd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec036304-e77f-4d3b-8890-ad69b953ed99]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== disconnect_volume: return (264ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG nova.objects.instance [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'flavor' on Instance uuid 01c3ee8c-322c-42c6-8c33-22ae16e77c46 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:06:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-7bcd894a-8022-4c2f-8889-4e546d7096cd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.635s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:56 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:06:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:06:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:06:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:06:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:00 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:07:00 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8414MB free_disk=25.05440902709961GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca153542-ced0-4884-827f-7af9517b6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:07:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:01 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:07:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:24 user nova-compute[75813]: INFO nova.compute.manager [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Terminating instance
Nov 15 13:07:24 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:07:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-89886d23-cb16-4f95-9dd9-e5149bae7ff7 req-ea11dbdd-f07d-4de9-b629-18bec8ccf1ce service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-vif-unplugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-89886d23-cb16-4f95-9dd9-e5149bae7ff7 req-ea11dbdd-f07d-4de9-b629-18bec8ccf1ce service nova] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-89886d23-cb16-4f95-9dd9-e5149bae7ff7 req-ea11dbdd-f07d-4de9-b629-18bec8ccf1ce service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-89886d23-cb16-4f95-9dd9-e5149bae7ff7 req-ea11dbdd-f07d-4de9-b629-18bec8ccf1ce service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-89886d23-cb16-4f95-9dd9-e5149bae7ff7 req-ea11dbdd-f07d-4de9-b629-18bec8ccf1ce service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] No waiting events found dispatching network-vif-unplugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-89886d23-cb16-4f95-9dd9-e5149bae7ff7 req-ea11dbdd-f07d-4de9-b629-18bec8ccf1ce service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-vif-unplugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:07:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Instance destroyed successfully.
Nov 15 13:07:25 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'resources' on Instance uuid 01c3ee8c-322c-42c6-8c33-22ae16e77c46 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T13:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-347681257',display_name='tempest-ServerActionsTestOtherA-server-1592404365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-347681257',id=28,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWQ0qmhy85GCBxBGKQ9gZY2Ij6XIXZ3e/Cefm0CoRTimt6Q7nvDlRwdtiaKTZS3e9QvWhzJJ7QwsM+NlsX4ZLpkyPKST4L/BpcsrIqva0sn5bllqIOgT8Pqn7YOrF5QTw==',key_name='tempest-keypair-1734348321',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:03:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-m5s0icbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=01c3ee8c-322c-42c6-8c33-22ae16e77c46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "address": "fa:16:3e:3c:4a:8e", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b054cd-cd", "ovs_interfaceid": "51b054cd-cd32-4efa-9b1f-4b6257025c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG os_vif [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51b054cd-cd, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66358e9b-bc7f-40db-bf85-21c0c113c3cd) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:07:25 user nova-compute[75813]: INFO os_vif [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=51b054cd-cd32-4efa-9b1f-4b6257025c45,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b054cd-cd')
Nov 15 13:07:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Deleting instance files /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46_del
Nov 15 13:07:25 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Deletion of /opt/stack/data/nova/instances/01c3ee8c-322c-42c6-8c33-22ae16e77c46_del complete
Nov 15 13:07:25 user nova-compute[75813]: INFO nova.compute.manager [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 13:07:25 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:07:25 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:07:26 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:07:26 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Took 0.84 seconds to deallocate network for instance.
Nov 15 13:07:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:26 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:07:26 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:07:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:26 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Deleted allocations for instance 01c3ee8c-322c-42c6-8c33-22ae16e77c46
Nov 15 13:07:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a3c2abe5-712d-4282-9208-dd73bf191be8 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.113s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-97a3753c-08a3-4fac-9492-8b076f76a3a7 req-66e54165-a6f7-4a40-a9b4-b1e1acf667bf service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-97a3753c-08a3-4fac-9492-8b076f76a3a7 req-66e54165-a6f7-4a40-a9b4-b1e1acf667bf service nova] Acquiring lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-97a3753c-08a3-4fac-9492-8b076f76a3a7 req-66e54165-a6f7-4a40-a9b4-b1e1acf667bf service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-97a3753c-08a3-4fac-9492-8b076f76a3a7 req-66e54165-a6f7-4a40-a9b4-b1e1acf667bf service nova] Lock "01c3ee8c-322c-42c6-8c33-22ae16e77c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-97a3753c-08a3-4fac-9492-8b076f76a3a7 req-66e54165-a6f7-4a40-a9b4-b1e1acf667bf service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] No waiting events found dispatching network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:07:27 user nova-compute[75813]: WARNING nova.compute.manager [req-97a3753c-08a3-4fac-9492-8b076f76a3a7 req-66e54165-a6f7-4a40-a9b4-b1e1acf667bf service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received unexpected event network-vif-plugged-51b054cd-cd32-4efa-9b1f-4b6257025c45 for instance with vm_state deleted and task_state None.
Nov 15 13:07:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-97a3753c-08a3-4fac-9492-8b076f76a3a7 req-66e54165-a6f7-4a40-a9b4-b1e1acf667bf service nova] [instance: 01c3ee8c-322c-42c6-8c33-22ae16e77c46] Received event network-vif-deleted-51b054cd-cd32-4efa-9b1f-4b6257025c45 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "ca55ee20-1155-4312-8508-a223654cd615" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:07:43 user nova-compute[75813]: INFO nova.compute.claims [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Claim successful on node user
Nov 15 13:07:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.031s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:07:43 user nova-compute[75813]: INFO nova.compute.claims [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Claim successful on node user
Nov 15 13:07:43 user nova-compute[75813]: DEBUG nova.compute.manager [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:07:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:07:43 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.policy [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '754cbdd42e894349bdacf3a0c7ba06cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71da470a3bdb4093bc2b5db0b66fa08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:07:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Creating image(s)
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.299s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:07:44 user nova-compute[75813]: INFO nova.compute.claims [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Claim successful on node user
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:07:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.202s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk 1073741824" returned: 0 in 0.065s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.policy [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f68d31c0d9bc4a66b3d81a892dee65ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78719b197c4db7bc6a13e3a57f3cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:07:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Creating image(s)
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "/opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "/opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "/opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Successfully created port: ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Cannot resize image /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Ensure instance console log exists: /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk 1073741824" returned: 0 in 0.065s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:45 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.policy [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '754cbdd42e894349bdacf3a0c7ba06cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71da470a3bdb4093bc2b5db0b66fa08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:07:45 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Creating image(s)
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "/opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Cannot resize image /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Ensure instance console log exists: /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Successfully created port: c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Successfully updated port: ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk 1073741824" returned: 0 in 0.053s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquired lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-5569a41f-92c1-4431-aa76-9b03fefb6764 req-77e54d07-5c11-419f-9cc3-3ceaa7cdec09 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-changed-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-5569a41f-92c1-4431-aa76-9b03fefb6764 req-77e54d07-5c11-419f-9cc3-3ceaa7cdec09 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Refreshing instance network info cache due to event network-changed-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5569a41f-92c1-4431-aa76-9b03fefb6764 req-77e54d07-5c11-419f-9cc3-3ceaa7cdec09 service nova] Acquiring lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:07:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Successfully created port: 7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.196s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Cannot resize image /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Ensure instance console log exists: /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updating instance_info_cache with network_info: [{"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Releasing lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Instance network_info: |[{"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5569a41f-92c1-4431-aa76-9b03fefb6764 req-77e54d07-5c11-419f-9cc3-3ceaa7cdec09 service nova] Acquired lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.neutron [req-5569a41f-92c1-4431-aa76-9b03fefb6764 req-77e54d07-5c11-419f-9cc3-3ceaa7cdec09 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Refreshing network info cache for port ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Start _get_guest_xml network_info=[{"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:07:46 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:07:46 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-988378064',display_name='tempest-ServerRescueNegativeTestJSON-server-988378064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-988378064',id=33,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-81rws25z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:07:44Z,user_data=None,user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=ca55ee20-1155-4312-8508-a223654cd615,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2f:d1,bridge_name='br-int',has_traffic_filtering=True,id=ab9960cf-b2b9-45d5-aedd-a314edf7cbe4,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9960cf-b2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.objects.instance [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'pci_devices' on Instance uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:07:46 user nova-compute[75813]:   <uuid>ca55ee20-1155-4312-8508-a223654cd615</uuid>
Nov 15 13:07:46 user nova-compute[75813]:   <name>instance-00000021</name>
Nov 15 13:07:46 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:07:46 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:07:46 user nova-compute[75813]:   <metadata>
Nov 15 13:07:46 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:07:46 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:07:46 user nova-compute[75813]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-988378064</nova:name>
Nov 15 13:07:46 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:07:46</nova:creationTime>
Nov 15 13:07:46 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:07:46 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:07:46 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:07:46 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:07:46 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:07:46 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:07:46 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:07:46 user nova-compute[75813]:       <nova:owner>
Nov 15 13:07:46 user nova-compute[75813]:         <nova:user uuid="754cbdd42e894349bdacf3a0c7ba06cc">tempest-ServerRescueNegativeTestJSON-1475327670-project-member</nova:user>
Nov 15 13:07:46 user nova-compute[75813]:         <nova:project uuid="71da470a3bdb4093bc2b5db0b66fa08e">tempest-ServerRescueNegativeTestJSON-1475327670</nova:project>
Nov 15 13:07:46 user nova-compute[75813]:       </nova:owner>
Nov 15 13:07:46 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:07:46 user nova-compute[75813]:       <nova:ports>
Nov 15 13:07:46 user nova-compute[75813]:         <nova:port uuid="ab9960cf-b2b9-45d5-aedd-a314edf7cbe4">
Nov 15 13:07:46 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 13:07:46 user nova-compute[75813]:         </nova:port>
Nov 15 13:07:46 user nova-compute[75813]:       </nova:ports>
Nov 15 13:07:46 user nova-compute[75813]:     </nova:instance>
Nov 15 13:07:46 user nova-compute[75813]:   </metadata>
Nov 15 13:07:46 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:07:46 user nova-compute[75813]:     <system>
Nov 15 13:07:46 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:07:46 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:07:46 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:07:46 user nova-compute[75813]:       <entry name="serial">ca55ee20-1155-4312-8508-a223654cd615</entry>
Nov 15 13:07:46 user nova-compute[75813]:       <entry name="uuid">ca55ee20-1155-4312-8508-a223654cd615</entry>
Nov 15 13:07:46 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:07:46 user nova-compute[75813]:     </system>
Nov 15 13:07:46 user nova-compute[75813]:   </sysinfo>
Nov 15 13:07:46 user nova-compute[75813]:   <os>
Nov 15 13:07:46 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:07:46 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:07:46 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:07:46 user nova-compute[75813]:   </os>
Nov 15 13:07:46 user nova-compute[75813]:   <features>
Nov 15 13:07:46 user nova-compute[75813]:     <acpi/>
Nov 15 13:07:46 user nova-compute[75813]:     <apic/>
Nov 15 13:07:46 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:07:46 user nova-compute[75813]:   </features>
Nov 15 13:07:46 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:07:46 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:07:46 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:07:46 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:07:46 user nova-compute[75813]:   </clock>
Nov 15 13:07:46 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:07:46 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:07:46 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:07:46 user nova-compute[75813]:   </cpu>
Nov 15 13:07:46 user nova-compute[75813]:   <devices>
Nov 15 13:07:46 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:07:46 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:07:46 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk"/>
Nov 15 13:07:46 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:07:46 user nova-compute[75813]:     </disk>
Nov 15 13:07:46 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:07:46 user nova-compute[75813]:       <mac address="fa:16:3e:1b:2f:d1"/>
Nov 15 13:07:46 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:07:46 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:07:46 user nova-compute[75813]:       <target dev="tapab9960cf-b2"/>
Nov 15 13:07:46 user nova-compute[75813]:     </interface>
Nov 15 13:07:46 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:07:46 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/console.log" append="off"/>
Nov 15 13:07:46 user nova-compute[75813]:     </serial>
Nov 15 13:07:46 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:07:46 user nova-compute[75813]:     <video>
Nov 15 13:07:46 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:07:46 user nova-compute[75813]:     </video>
Nov 15 13:07:46 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:07:46 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:07:46 user nova-compute[75813]:     </rng>
Nov 15 13:07:46 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:07:46 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:07:46 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:07:46 user nova-compute[75813]:     </memballoon>
Nov 15 13:07:46 user nova-compute[75813]:   </devices>
Nov 15 13:07:46 user nova-compute[75813]: </domain>
Nov 15 13:07:46 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-988378064',display_name='tempest-ServerRescueNegativeTestJSON-server-988378064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-988378064',id=33,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-81rws25z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:07:44Z,user_data=None,user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=ca55ee20-1155-4312-8508-a223654cd615,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2f:d1,bridge_name='br-int',has_traffic_filtering=True,id=ab9960cf-b2b9-45d5-aedd-a314edf7cbe4,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9960cf-b2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG os_vif [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2f:d1,bridge_name='br-int',has_traffic_filtering=True,id=ab9960cf-b2b9-45d5-aedd-a314edf7cbe4,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9960cf-b2') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Successfully updated port: c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0ffe319-59ee-5909-991a-56d7bc266240', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab9960cf-b2, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab9960cf-b2, col_values=(('qos', UUID('41d1e720-ee6c-45a3-99e3-5217eece5ea8')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab9960cf-b2, col_values=(('external_ids', {'iface-id': 'ab9960cf-b2b9-45d5-aedd-a314edf7cbe4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:2f:d1', 'vm-uuid': 'ca55ee20-1155-4312-8508-a223654cd615'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "refresh_cache-4eb83276-6ce5-44c1-bd80-95c9bcba1d52" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquired lock "refresh_cache-4eb83276-6ce5-44c1-bd80-95c9bcba1d52" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:46 user nova-compute[75813]: INFO os_vif [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2f:d1,bridge_name='br-int',has_traffic_filtering=True,id=ab9960cf-b2b9-45d5-aedd-a314edf7cbe4,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9960cf-b2')
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No VIF found with MAC fa:16:3e:1b:2f:d1, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Successfully updated port: 7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquired lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-f0899567-e1be-4bbc-8122-79981ebbf2b9 req-b24a7a5a-6074-44cc-9ba1-68402a7319df service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received event network-changed-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-f0899567-e1be-4bbc-8122-79981ebbf2b9 req-b24a7a5a-6074-44cc-9ba1-68402a7319df service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Refreshing instance network info cache due to event network-changed-7f83e206-bb7e-4d53-a7fa-00c36bf649de. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f0899567-e1be-4bbc-8122-79981ebbf2b9 req-b24a7a5a-6074-44cc-9ba1-68402a7319df service nova] Acquiring lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:07:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Updating instance_info_cache with network_info: [{"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Releasing lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Instance network_info: |[{"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f0899567-e1be-4bbc-8122-79981ebbf2b9 req-b24a7a5a-6074-44cc-9ba1-68402a7319df service nova] Acquired lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-f0899567-e1be-4bbc-8122-79981ebbf2b9 req-b24a7a5a-6074-44cc-9ba1-68402a7319df service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Refreshing network info cache for port 7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Start _get_guest_xml network_info=[{"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:07:47 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:07:47 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556918182',display_name='tempest-ServerRescueNegativeTestJSON-server-1556918182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556918182',id=35,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-jo61jy29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:07:45Z,user_data=None,user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=eaff87f2-d74c-4e1b-b471-33bd1aeeed34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=7f83e206-bb7e-4d53-a7fa-00c36bf649de,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f83e206-bb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.objects.instance [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'pci_devices' on Instance uuid eaff87f2-d74c-4e1b-b471-33bd1aeeed34 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:07:47 user nova-compute[75813]:   <uuid>eaff87f2-d74c-4e1b-b471-33bd1aeeed34</uuid>
Nov 15 13:07:47 user nova-compute[75813]:   <name>instance-00000023</name>
Nov 15 13:07:47 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:07:47 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:07:47 user nova-compute[75813]:   <metadata>
Nov 15 13:07:47 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:07:47 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1556918182</nova:name>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:07:47</nova:creationTime>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:07:47 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:07:47 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:owner>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:user uuid="754cbdd42e894349bdacf3a0c7ba06cc">tempest-ServerRescueNegativeTestJSON-1475327670-project-member</nova:user>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:project uuid="71da470a3bdb4093bc2b5db0b66fa08e">tempest-ServerRescueNegativeTestJSON-1475327670</nova:project>
Nov 15 13:07:47 user nova-compute[75813]:       </nova:owner>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:ports>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:port uuid="7f83e206-bb7e-4d53-a7fa-00c36bf649de">
Nov 15 13:07:47 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 13:07:47 user nova-compute[75813]:         </nova:port>
Nov 15 13:07:47 user nova-compute[75813]:       </nova:ports>
Nov 15 13:07:47 user nova-compute[75813]:     </nova:instance>
Nov 15 13:07:47 user nova-compute[75813]:   </metadata>
Nov 15 13:07:47 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:07:47 user nova-compute[75813]:     <system>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="serial">eaff87f2-d74c-4e1b-b471-33bd1aeeed34</entry>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="uuid">eaff87f2-d74c-4e1b-b471-33bd1aeeed34</entry>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:07:47 user nova-compute[75813]:     </system>
Nov 15 13:07:47 user nova-compute[75813]:   </sysinfo>
Nov 15 13:07:47 user nova-compute[75813]:   <os>
Nov 15 13:07:47 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:07:47 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:07:47 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:07:47 user nova-compute[75813]:   </os>
Nov 15 13:07:47 user nova-compute[75813]:   <features>
Nov 15 13:07:47 user nova-compute[75813]:     <acpi/>
Nov 15 13:07:47 user nova-compute[75813]:     <apic/>
Nov 15 13:07:47 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:07:47 user nova-compute[75813]:   </features>
Nov 15 13:07:47 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:07:47 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:07:47 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:07:47 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:07:47 user nova-compute[75813]:   </clock>
Nov 15 13:07:47 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:07:47 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:07:47 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:07:47 user nova-compute[75813]:   </cpu>
Nov 15 13:07:47 user nova-compute[75813]:   <devices>
Nov 15 13:07:47 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:07:47 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:07:47 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk"/>
Nov 15 13:07:47 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:07:47 user nova-compute[75813]:     </disk>
Nov 15 13:07:47 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:07:47 user nova-compute[75813]:       <mac address="fa:16:3e:72:7b:99"/>
Nov 15 13:07:47 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:07:47 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:07:47 user nova-compute[75813]:       <target dev="tap7f83e206-bb"/>
Nov 15 13:07:47 user nova-compute[75813]:     </interface>
Nov 15 13:07:47 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:07:47 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/console.log" append="off"/>
Nov 15 13:07:47 user nova-compute[75813]:     </serial>
Nov 15 13:07:47 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:07:47 user nova-compute[75813]:     <video>
Nov 15 13:07:47 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:07:47 user nova-compute[75813]:     </video>
Nov 15 13:07:47 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:07:47 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:07:47 user nova-compute[75813]:     </rng>
Nov 15 13:07:47 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:07:47 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:07:47 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:07:47 user nova-compute[75813]:     </memballoon>
Nov 15 13:07:47 user nova-compute[75813]:   </devices>
Nov 15 13:07:47 user nova-compute[75813]: </domain>
Nov 15 13:07:47 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556918182',display_name='tempest-ServerRescueNegativeTestJSON-server-1556918182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556918182',id=35,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-jo61jy29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:07:45Z,user_data=None,user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=eaff87f2-d74c-4e1b-b471-33bd1aeeed34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=7f83e206-bb7e-4d53-a7fa-00c36bf649de,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f83e206-bb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG os_vif [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=7f83e206-bb7e-4d53-a7fa-00c36bf649de,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f83e206-bb') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '444ab850-29bb-5047-a9c0-1f816a81d9ad', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f83e206-bb, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f83e206-bb, col_values=(('qos', UUID('9ac9a577-cc22-49f1-8784-52b7786e9650')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f83e206-bb, col_values=(('external_ids', {'iface-id': '7f83e206-bb7e-4d53-a7fa-00c36bf649de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:7b:99', 'vm-uuid': 'eaff87f2-d74c-4e1b-b471-33bd1aeeed34'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Updating instance_info_cache with network_info: [{"id": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "address": "fa:16:3e:eb:fd:6f", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc111045e-87", "ovs_interfaceid": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-5569a41f-92c1-4431-aa76-9b03fefb6764 req-77e54d07-5c11-419f-9cc3-3ceaa7cdec09 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updated VIF entry in instance network info cache for port ab9960cf-b2b9-45d5-aedd-a314edf7cbe4. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-5569a41f-92c1-4431-aa76-9b03fefb6764 req-77e54d07-5c11-419f-9cc3-3ceaa7cdec09 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updating instance_info_cache with network_info: [{"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: INFO os_vif [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=7f83e206-bb7e-4d53-a7fa-00c36bf649de,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f83e206-bb')
Nov 15 13:07:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5569a41f-92c1-4431-aa76-9b03fefb6764 req-77e54d07-5c11-419f-9cc3-3ceaa7cdec09 service nova] Releasing lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Releasing lock "refresh_cache-4eb83276-6ce5-44c1-bd80-95c9bcba1d52" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Instance network_info: |[{"id": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "address": "fa:16:3e:eb:fd:6f", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc111045e-87", "ovs_interfaceid": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Start _get_guest_xml network_info=[{"id": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "address": "fa:16:3e:eb:fd:6f", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc111045e-87", "ovs_interfaceid": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:07:47 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:07:47 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-46578006',display_name='tempest-AttachVolumeTestJSON-server-46578006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-46578006',id=34,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1+eECWI4qsBCB+9D0JdGKKZ+ESHsaK3DU4OyLplQs5WRKr8qqLYDqL06liSq36erBgI4fq6DC/BTKndyPzy5zJgcncKxGaGihNnwQqHwDQR2N1xmmUYjQ6ZumPzXnijg==',key_name='tempest-keypair-1128975402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-s6n5xmf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=4eb83276-6ce5-44c1-bd80-95c9bcba1d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "address": "fa:16:3e:eb:fd:6f", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc111045e-87", "ovs_interfaceid": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "address": "fa:16:3e:eb:fd:6f", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc111045e-87", "ovs_interfaceid": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fd:6f,bridge_name='br-int',has_traffic_filtering=True,id=c111045e-8778-439e-ac12-ce8b5f2c58a3,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc111045e-87') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.objects.instance [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'pci_devices' on Instance uuid 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:07:47 user nova-compute[75813]:   <uuid>4eb83276-6ce5-44c1-bd80-95c9bcba1d52</uuid>
Nov 15 13:07:47 user nova-compute[75813]:   <name>instance-00000022</name>
Nov 15 13:07:47 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:07:47 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:07:47 user nova-compute[75813]:   <metadata>
Nov 15 13:07:47 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:07:47 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeTestJSON-server-46578006</nova:name>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:07:47</nova:creationTime>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:07:47 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:07:47 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:owner>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:user uuid="f68d31c0d9bc4a66b3d81a892dee65ef">tempest-AttachVolumeTestJSON-45300677-project-member</nova:user>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:project uuid="fc78719b197c4db7bc6a13e3a57f3cb2">tempest-AttachVolumeTestJSON-45300677</nova:project>
Nov 15 13:07:47 user nova-compute[75813]:       </nova:owner>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:07:47 user nova-compute[75813]:       <nova:ports>
Nov 15 13:07:47 user nova-compute[75813]:         <nova:port uuid="c111045e-8778-439e-ac12-ce8b5f2c58a3">
Nov 15 13:07:47 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 13:07:47 user nova-compute[75813]:         </nova:port>
Nov 15 13:07:47 user nova-compute[75813]:       </nova:ports>
Nov 15 13:07:47 user nova-compute[75813]:     </nova:instance>
Nov 15 13:07:47 user nova-compute[75813]:   </metadata>
Nov 15 13:07:47 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:07:47 user nova-compute[75813]:     <system>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="serial">4eb83276-6ce5-44c1-bd80-95c9bcba1d52</entry>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="uuid">4eb83276-6ce5-44c1-bd80-95c9bcba1d52</entry>
Nov 15 13:07:47 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:07:47 user nova-compute[75813]:     </system>
Nov 15 13:07:47 user nova-compute[75813]:   </sysinfo>
Nov 15 13:07:47 user nova-compute[75813]:   <os>
Nov 15 13:07:47 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:07:47 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:07:47 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:07:47 user nova-compute[75813]:   </os>
Nov 15 13:07:47 user nova-compute[75813]:   <features>
Nov 15 13:07:47 user nova-compute[75813]:     <acpi/>
Nov 15 13:07:47 user nova-compute[75813]:     <apic/>
Nov 15 13:07:47 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:07:47 user nova-compute[75813]:   </features>
Nov 15 13:07:47 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:07:47 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:07:47 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:07:47 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:07:47 user nova-compute[75813]:   </clock>
Nov 15 13:07:47 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:07:47 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:07:47 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:07:47 user nova-compute[75813]:   </cpu>
Nov 15 13:07:47 user nova-compute[75813]:   <devices>
Nov 15 13:07:47 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:07:47 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:07:47 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk"/>
Nov 15 13:07:47 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:07:47 user nova-compute[75813]:     </disk>
Nov 15 13:07:47 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:07:47 user nova-compute[75813]:       <mac address="fa:16:3e:eb:fd:6f"/>
Nov 15 13:07:47 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:07:47 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:07:47 user nova-compute[75813]:       <target dev="tapc111045e-87"/>
Nov 15 13:07:47 user nova-compute[75813]:     </interface>
Nov 15 13:07:47 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:07:47 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/console.log" append="off"/>
Nov 15 13:07:47 user nova-compute[75813]:     </serial>
Nov 15 13:07:47 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:07:47 user nova-compute[75813]:     <video>
Nov 15 13:07:47 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:07:47 user nova-compute[75813]:     </video>
Nov 15 13:07:47 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:07:47 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:07:47 user nova-compute[75813]:     </rng>
Nov 15 13:07:47 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:07:47 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:07:47 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:07:47 user nova-compute[75813]:     </memballoon>
Nov 15 13:07:47 user nova-compute[75813]:   </devices>
Nov 15 13:07:47 user nova-compute[75813]: </domain>
Nov 15 13:07:47 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-46578006',display_name='tempest-AttachVolumeTestJSON-server-46578006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-46578006',id=34,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1+eECWI4qsBCB+9D0JdGKKZ+ESHsaK3DU4OyLplQs5WRKr8qqLYDqL06liSq36erBgI4fq6DC/BTKndyPzy5zJgcncKxGaGihNnwQqHwDQR2N1xmmUYjQ6ZumPzXnijg==',key_name='tempest-keypair-1128975402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-s6n5xmf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=4eb83276-6ce5-44c1-bd80-95c9bcba1d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "address": "fa:16:3e:eb:fd:6f", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc111045e-87", "ovs_interfaceid": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "address": "fa:16:3e:eb:fd:6f", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc111045e-87", "ovs_interfaceid": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fd:6f,bridge_name='br-int',has_traffic_filtering=True,id=c111045e-8778-439e-ac12-ce8b5f2c58a3,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc111045e-87') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG os_vif [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fd:6f,bridge_name='br-int',has_traffic_filtering=True,id=c111045e-8778-439e-ac12-ce8b5f2c58a3,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc111045e-87') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99d29a12-7606-543e-b384-5e251447e7b9', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No VIF found with MAC fa:16:3e:72:7b:99, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc111045e-87, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc111045e-87, col_values=(('qos', UUID('bc659087-6532-43bc-b890-c4cc3304be33')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc111045e-87, col_values=(('external_ids', {'iface-id': 'c111045e-8778-439e-ac12-ce8b5f2c58a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:fd:6f', 'vm-uuid': '4eb83276-6ce5-44c1-bd80-95c9bcba1d52'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:47 user nova-compute[75813]: INFO os_vif [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:fd:6f,bridge_name='br-int',has_traffic_filtering=True,id=c111045e-8778-439e-ac12-ce8b5f2c58a3,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc111045e-87')
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No VIF found with MAC fa:16:3e:eb:fd:6f, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-f0899567-e1be-4bbc-8122-79981ebbf2b9 req-b24a7a5a-6074-44cc-9ba1-68402a7319df service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Updated VIF entry in instance network info cache for port 7f83e206-bb7e-4d53-a7fa-00c36bf649de. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-f0899567-e1be-4bbc-8122-79981ebbf2b9 req-b24a7a5a-6074-44cc-9ba1-68402a7319df service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Updating instance_info_cache with network_info: [{"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f0899567-e1be-4bbc-8122-79981ebbf2b9 req-b24a7a5a-6074-44cc-9ba1-68402a7319df service nova] Releasing lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-964ac6bd-6f8e-4675-b597-be1b0d6ace65 req-21736861-1c37-41e6-a69b-62bb162bf5c2 service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Received event network-changed-c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-964ac6bd-6f8e-4675-b597-be1b0d6ace65 req-21736861-1c37-41e6-a69b-62bb162bf5c2 service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Refreshing instance network info cache due to event network-changed-c111045e-8778-439e-ac12-ce8b5f2c58a3. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-964ac6bd-6f8e-4675-b597-be1b0d6ace65 req-21736861-1c37-41e6-a69b-62bb162bf5c2 service nova] Acquiring lock "refresh_cache-4eb83276-6ce5-44c1-bd80-95c9bcba1d52" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-964ac6bd-6f8e-4675-b597-be1b0d6ace65 req-21736861-1c37-41e6-a69b-62bb162bf5c2 service nova] Acquired lock "refresh_cache-4eb83276-6ce5-44c1-bd80-95c9bcba1d52" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:07:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-964ac6bd-6f8e-4675-b597-be1b0d6ace65 req-21736861-1c37-41e6-a69b-62bb162bf5c2 service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Refreshing network info cache for port c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:07:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-964ac6bd-6f8e-4675-b597-be1b0d6ace65 req-21736861-1c37-41e6-a69b-62bb162bf5c2 service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Updated VIF entry in instance network info cache for port c111045e-8778-439e-ac12-ce8b5f2c58a3. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:07:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-964ac6bd-6f8e-4675-b597-be1b0d6ace65 req-21736861-1c37-41e6-a69b-62bb162bf5c2 service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Updating instance_info_cache with network_info: [{"id": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "address": "fa:16:3e:eb:fd:6f", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc111045e-87", "ovs_interfaceid": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:07:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-964ac6bd-6f8e-4675-b597-be1b0d6ace65 req-21736861-1c37-41e6-a69b-62bb162bf5c2 service nova] Releasing lock "refresh_cache-4eb83276-6ce5-44c1-bd80-95c9bcba1d52" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:07:49 user nova-compute[75813]: WARNING nova.compute.manager [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received unexpected event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with vm_state building and task_state spawning.
Nov 15 13:07:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:07:49 user nova-compute[75813]: WARNING nova.compute.manager [req-ef334c22-9c8f-4f96-b768-b04725770b02 req-3f7747d6-6faa-4895-a2bb-fedb6025a8d8 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received unexpected event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with vm_state building and task_state spawning.
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-8afefd49-0bb6-4f5e-b615-d87ae13bbb89 req-26b77b4c-0254-47e2-a697-26cde7e65ac9 service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Received event network-vif-plugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8afefd49-0bb6-4f5e-b615-d87ae13bbb89 req-26b77b4c-0254-47e2-a697-26cde7e65ac9 service nova] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8afefd49-0bb6-4f5e-b615-d87ae13bbb89 req-26b77b4c-0254-47e2-a697-26cde7e65ac9 service nova] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8afefd49-0bb6-4f5e-b615-d87ae13bbb89 req-26b77b4c-0254-47e2-a697-26cde7e65ac9 service nova] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-8afefd49-0bb6-4f5e-b615-d87ae13bbb89 req-26b77b4c-0254-47e2-a697-26cde7e65ac9 service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] No waiting events found dispatching network-vif-plugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:07:51 user nova-compute[75813]: WARNING nova.compute.manager [req-8afefd49-0bb6-4f5e-b615-d87ae13bbb89 req-26b77b4c-0254-47e2-a697-26cde7e65ac9 service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Received unexpected event network-vif-plugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 for instance with vm_state building and task_state spawning.
Nov 15 13:07:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca55ee20-1155-4312-8508-a223654cd615] Skipping network cache update for instance because it is Building. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Skipping network cache update for instance because it is Building. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Skipping network cache update for instance because it is Building. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid 70ddb35e-bc7c-4e18-8028-54496eef0cce {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updating instance_info_cache with network_info: [{"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:07:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] No waiting events found dispatching network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:07:52 user nova-compute[75813]: WARNING nova.compute.manager [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received unexpected event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de for instance with vm_state building and task_state spawning.
Nov 15 13:07:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] No waiting events found dispatching network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:07:52 user nova-compute[75813]: WARNING nova.compute.manager [req-5dfb38ff-e7b0-4f32-978f-8337b3696a27 req-03dfa62c-755e-469c-80a4-55541c966b0b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received unexpected event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de for instance with vm_state building and task_state spawning.
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:07:52 user nova-compute[75813]: INFO nova.compute.manager [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] instance snapshotting
Nov 15 13:07:52 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Beginning live snapshot process
Nov 15 13:07:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json -f qcow2 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json -f qcow2 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.compute.manager [req-a8dcd55e-469a-461a-b53d-12e81359b161 req-bc36428d-bd1c-4ec6-bc39-9acf8c16a6ff service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Received event network-vif-plugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8dcd55e-469a-461a-b53d-12e81359b161 req-bc36428d-bd1c-4ec6-bc39-9acf8c16a6ff service nova] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8dcd55e-469a-461a-b53d-12e81359b161 req-bc36428d-bd1c-4ec6-bc39-9acf8c16a6ff service nova] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8dcd55e-469a-461a-b53d-12e81359b161 req-bc36428d-bd1c-4ec6-bc39-9acf8c16a6ff service nova] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.compute.manager [req-a8dcd55e-469a-461a-b53d-12e81359b161 req-bc36428d-bd1c-4ec6-bc39-9acf8c16a6ff service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] No waiting events found dispatching network-vif-plugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:07:53 user nova-compute[75813]: WARNING nova.compute.manager [req-a8dcd55e-469a-461a-b53d-12e81359b161 req-bc36428d-bd1c-4ec6-bc39-9acf8c16a6ff service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Received unexpected event network-vif-plugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 for instance with vm_state building and task_state spawning.
Nov 15 13:07:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2n4b1jaj/4e535e7a84eb47dba0ea227cd18ce3ba.delta 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2n4b1jaj/4e535e7a84eb47dba0ea227cd18ce3ba.delta 1073741824" returned: 0 in 0.091s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:53 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:07:53 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: ca55ee20-1155-4312-8508-a223654cd615] Instance spawned successfully.
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:07:53 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Instance spawned successfully.
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Instance spawned successfully.
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:07:53 user nova-compute[75813]: INFO nova.compute.manager [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Took 9.32 seconds to spawn the instance on the hypervisor.
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:07:53 user nova-compute[75813]: INFO nova.compute.manager [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Took 8.10 seconds to spawn the instance on the hypervisor.
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:07:53 user nova-compute[75813]: INFO nova.compute.manager [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Took 8.82 seconds to spawn the instance on the hypervisor.
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:07:53 user nova-compute[75813]: INFO nova.compute.manager [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Took 10.03 seconds to build instance.
Nov 15 13:07:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5eece76a-ed38-4049-8734-4bc534b82f65 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "ca55ee20-1155-4312-8508-a223654cd615" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.135s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:53 user nova-compute[75813]: INFO nova.compute.manager [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Took 9.52 seconds to build instance.
Nov 15 13:07:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-12610f93-3b45-498b-878d-de9faa01c5e0 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.623s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:53 user nova-compute[75813]: INFO nova.compute.manager [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Took 9.80 seconds to build instance.
Nov 15 13:07:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bac99176-8b2c-400e-a5ba-c0e11f2a31b4 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.910s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 13:07:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 13:07:54 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 13:07:54 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:07:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2n4b1jaj/4e535e7a84eb47dba0ea227cd18ce3ba.delta /opt/stack/data/nova/instances/snapshots/tmp2n4b1jaj/4e535e7a84eb47dba0ea227cd18ce3ba {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2n4b1jaj/4e535e7a84eb47dba0ea227cd18ce3ba.delta /opt/stack/data/nova/instances/snapshots/tmp2n4b1jaj/4e535e7a84eb47dba0ea227cd18ce3ba" returned: 0 in 0.483s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:55 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Snapshot extracted, beginning image upload
Nov 15 13:07:55 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:07:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:56 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:07:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:07:58 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Snapshot image upload complete
Nov 15 13:07:58 user nova-compute[75813]: INFO nova.compute.manager [None req-1e9c8be9-8161-483f-91a6-a4cef7a5f349 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Took 5.65 seconds to snapshot the instance on the hypervisor.
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:07:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:07:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:08:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:08:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:01 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:08:01 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8327MB free_disk=25.020366668701172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca153542-ced0-4884-827f-7af9517b6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:08:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:08:03 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:08:03 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:08:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:26 user nova-compute[75813]: INFO nova.compute.manager [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Unshelving
Nov 15 13:08:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:26 user nova-compute[75813]: DEBUG nova.objects.instance [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'pci_requests' on Instance uuid b74022f2-55af-4eb7-81e0-4696fefd5ae5 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:08:26 user nova-compute[75813]: DEBUG nova.objects.instance [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'numa_topology' on Instance uuid b74022f2-55af-4eb7-81e0-4696fefd5ae5 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:08:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:08:26 user nova-compute[75813]: INFO nova.compute.claims [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Claim successful on node user
Nov 15 13:08:26 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:08:26 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:08:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:27 user nova-compute[75813]: INFO nova.network.neutron [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Updating port 76c7059b-cb68-4832-940f-9832e339c26c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 13:08:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:08:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquired lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:08:27 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:08:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-c7187bd1-a40d-4e0b-9d4d-01ca487bdc70 req-c5bf3b2b-d189-42f5-831c-04546fe6eecd service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-changed-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:08:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-c7187bd1-a40d-4e0b-9d4d-01ca487bdc70 req-c5bf3b2b-d189-42f5-831c-04546fe6eecd service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Refreshing instance network info cache due to event network-changed-76c7059b-cb68-4832-940f-9832e339c26c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:08:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c7187bd1-a40d-4e0b-9d4d-01ca487bdc70 req-c5bf3b2b-d189-42f5-831c-04546fe6eecd service nova] Acquiring lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:08:28 user nova-compute[75813]: DEBUG nova.network.neutron [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Updating instance_info_cache with network_info: [{"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:08:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Releasing lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:08:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:08:28 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Creating image(s)
Nov 15 13:08:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "/opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "/opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "/opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:28 user nova-compute[75813]: DEBUG nova.objects.instance [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'trusted_certs' on Instance uuid b74022f2-55af-4eb7-81e0-4696fefd5ae5 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:08:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c7187bd1-a40d-4e0b-9d4d-01ca487bdc70 req-c5bf3b2b-d189-42f5-831c-04546fe6eecd service nova] Acquired lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:08:28 user nova-compute[75813]: DEBUG nova.network.neutron [req-c7187bd1-a40d-4e0b-9d4d-01ca487bdc70 req-c5bf3b2b-d189-42f5-831c-04546fe6eecd service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Refreshing network info cache for port 76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:08:28 user nova-compute[75813]: DEBUG nova.objects.base [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Object Instance<b74022f2-55af-4eb7-81e0-4696fefd5ae5> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:08:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "b05e30a718dfc796109c38e4c57b6574275cd4b8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b05e30a718dfc796109c38e4c57b6574275cd4b8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8.part --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG nova.virt.images [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] babe3620-24a1-4456-8164-4260c8414163 was qcow2, converting to raw {{(pid=75813) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8.part /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8.converted {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG nova.network.neutron [req-c7187bd1-a40d-4e0b-9d4d-01ca487bdc70 req-c5bf3b2b-d189-42f5-831c-04546fe6eecd service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Updated VIF entry in instance network info cache for port 76c7059b-cb68-4832-940f-9832e339c26c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG nova.network.neutron [req-c7187bd1-a40d-4e0b-9d4d-01ca487bdc70 req-c5bf3b2b-d189-42f5-831c-04546fe6eecd service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Updating instance_info_cache with network_info: [{"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c7187bd1-a40d-4e0b-9d4d-01ca487bdc70 req-c5bf3b2b-d189-42f5-831c-04546fe6eecd service nova] Releasing lock "refresh_cache-b74022f2-55af-4eb7-81e0-4696fefd5ae5" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-9a7226be-584d-483d-8add-9b11bf450464 req-4f384679-e1b8-4112-bac6-f73baceaff71 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Received event network-changed-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-9a7226be-584d-483d-8add-9b11bf450464 req-4f384679-e1b8-4112-bac6-f73baceaff71 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Refreshing instance network info cache due to event network-changed-c64a9689-ab31-4330-8a2b-02bb3ed8aba3. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9a7226be-584d-483d-8add-9b11bf450464 req-4f384679-e1b8-4112-bac6-f73baceaff71 service nova] Acquiring lock "refresh_cache-3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9a7226be-584d-483d-8add-9b11bf450464 req-4f384679-e1b8-4112-bac6-f73baceaff71 service nova] Acquired lock "refresh_cache-3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG nova.network.neutron [req-9a7226be-584d-483d-8add-9b11bf450464 req-4f384679-e1b8-4112-bac6-f73baceaff71 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Refreshing network info cache for port c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:08:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8.part /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8.converted" returned: 0 in 0.590s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8.converted --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG nova.network.neutron [req-9a7226be-584d-483d-8add-9b11bf450464 req-4f384679-e1b8-4112-bac6-f73baceaff71 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Updated VIF entry in instance network info cache for port c64a9689-ab31-4330-8a2b-02bb3ed8aba3. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG nova.network.neutron [req-9a7226be-584d-483d-8add-9b11bf450464 req-4f384679-e1b8-4112-bac6-f73baceaff71 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Updating instance_info_cache with network_info: [{"id": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "address": "fa:16:3e:49:23:51", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64a9689-ab", "ovs_interfaceid": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b05e30a718dfc796109c38e4c57b6574275cd4b8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.006s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9a7226be-584d-483d-8add-9b11bf450464 req-4f384679-e1b8-4112-bac6-f73baceaff71 service nova] Releasing lock "refresh_cache-3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8 --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "b05e30a718dfc796109c38e4c57b6574275cd4b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b05e30a718dfc796109c38e4c57b6574275cd4b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8 --force-share --output=json" returned: 0 in 0.186s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8,backing_fmt=raw /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8,backing_fmt=raw /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk 1073741824" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b05e30a718dfc796109c38e4c57b6574275cd4b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.383s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8 --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG nova.objects.instance [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'migration_context' on Instance uuid b74022f2-55af-4eb7-81e0-4696fefd5ae5 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:08:30 user nova-compute[75813]: DEBUG nova.objects.base [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Object Instance<b74022f2-55af-4eb7-81e0-4696fefd5ae5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:08:30 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Rebasing disk image.
Nov 15 13:08:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 -F raw /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 -F raw /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk" returned: 0 in 2.573s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Ensure instance console log exists: /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Start _get_guest_xml network_info=[{"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1ec72cac74dd2bb633527171b2f0a0f2',container_format='bare',created_at=2023-11-15T13:06:34Z,direct_url=<?>,disk_format='qcow2',id=babe3620-24a1-4456-8164-4260c8414163,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-781384000-shelved',owner='8eaef11927a74bd4a8dfa8f6a11ab367',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T13:06:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:08:33 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:08:33 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1ec72cac74dd2bb633527171b2f0a0f2',container_format='bare',created_at=2023-11-15T13:06:34Z,direct_url=<?>,disk_format='qcow2',id=babe3620-24a1-4456-8164-4260c8414163,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-781384000-shelved',owner='8eaef11927a74bd4a8dfa8f6a11ab367',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T13:06:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.objects.instance [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'vcpu_model' on Instance uuid b74022f2-55af-4eb7-81e0-4696fefd5ae5 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.objects.base [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Object Instance<b74022f2-55af-4eb7-81e0-4696fefd5ae5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T13:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-781384000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-781384000',id=30,image_ref='babe3620-24a1-4456-8164-4260c8414163',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1610888735',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-5d7gag7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member',shelved_at='2023-11-15T13:06:37.994323',shelved_host='user',shelved_image_id='babe3620-24a1-4456-8164-4260c8414163'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:08:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=b74022f2-55af-4eb7-81e0-4696fefd5ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.objects.instance [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'pci_devices' on Instance uuid b74022f2-55af-4eb7-81e0-4696fefd5ae5 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.objects.base [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Object Instance<b74022f2-55af-4eb7-81e0-4696fefd5ae5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:08:33 user nova-compute[75813]:   <uuid>b74022f2-55af-4eb7-81e0-4696fefd5ae5</uuid>
Nov 15 13:08:33 user nova-compute[75813]:   <name>instance-0000001e</name>
Nov 15 13:08:33 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:08:33 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:08:33 user nova-compute[75813]:   <metadata>
Nov 15 13:08:33 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:08:33 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:08:33 user nova-compute[75813]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-781384000</nova:name>
Nov 15 13:08:33 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:08:33</nova:creationTime>
Nov 15 13:08:33 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:08:33 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:08:33 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:08:33 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:08:33 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:08:33 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:08:33 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:08:33 user nova-compute[75813]:       <nova:owner>
Nov 15 13:08:33 user nova-compute[75813]:         <nova:user uuid="7f3642a668cd4e998ffbaf8f76f5d895">tempest-AttachVolumeShelveTestJSON-1167418523-project-member</nova:user>
Nov 15 13:08:33 user nova-compute[75813]:         <nova:project uuid="8eaef11927a74bd4a8dfa8f6a11ab367">tempest-AttachVolumeShelveTestJSON-1167418523</nova:project>
Nov 15 13:08:33 user nova-compute[75813]:       </nova:owner>
Nov 15 13:08:33 user nova-compute[75813]:       <nova:root type="image" uuid="babe3620-24a1-4456-8164-4260c8414163"/>
Nov 15 13:08:33 user nova-compute[75813]:       <nova:ports>
Nov 15 13:08:33 user nova-compute[75813]:         <nova:port uuid="76c7059b-cb68-4832-940f-9832e339c26c">
Nov 15 13:08:33 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 13:08:33 user nova-compute[75813]:         </nova:port>
Nov 15 13:08:33 user nova-compute[75813]:       </nova:ports>
Nov 15 13:08:33 user nova-compute[75813]:     </nova:instance>
Nov 15 13:08:33 user nova-compute[75813]:   </metadata>
Nov 15 13:08:33 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:08:33 user nova-compute[75813]:     <system>
Nov 15 13:08:33 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:08:33 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:08:33 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:08:33 user nova-compute[75813]:       <entry name="serial">b74022f2-55af-4eb7-81e0-4696fefd5ae5</entry>
Nov 15 13:08:33 user nova-compute[75813]:       <entry name="uuid">b74022f2-55af-4eb7-81e0-4696fefd5ae5</entry>
Nov 15 13:08:33 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:08:33 user nova-compute[75813]:     </system>
Nov 15 13:08:33 user nova-compute[75813]:   </sysinfo>
Nov 15 13:08:33 user nova-compute[75813]:   <os>
Nov 15 13:08:33 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:08:33 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:08:33 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:08:33 user nova-compute[75813]:   </os>
Nov 15 13:08:33 user nova-compute[75813]:   <features>
Nov 15 13:08:33 user nova-compute[75813]:     <acpi/>
Nov 15 13:08:33 user nova-compute[75813]:     <apic/>
Nov 15 13:08:33 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:08:33 user nova-compute[75813]:   </features>
Nov 15 13:08:33 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:08:33 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:08:33 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:08:33 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:08:33 user nova-compute[75813]:   </clock>
Nov 15 13:08:33 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:08:33 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:08:33 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:08:33 user nova-compute[75813]:   </cpu>
Nov 15 13:08:33 user nova-compute[75813]:   <devices>
Nov 15 13:08:33 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:08:33 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:08:33 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk"/>
Nov 15 13:08:33 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:08:33 user nova-compute[75813]:     </disk>
Nov 15 13:08:33 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:08:33 user nova-compute[75813]:       <mac address="fa:16:3e:b6:23:56"/>
Nov 15 13:08:33 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:08:33 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:08:33 user nova-compute[75813]:       <target dev="tap76c7059b-cb"/>
Nov 15 13:08:33 user nova-compute[75813]:     </interface>
Nov 15 13:08:33 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:08:33 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/console.log" append="off"/>
Nov 15 13:08:33 user nova-compute[75813]:     </serial>
Nov 15 13:08:33 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:08:33 user nova-compute[75813]:     <video>
Nov 15 13:08:33 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:08:33 user nova-compute[75813]:     </video>
Nov 15 13:08:33 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:08:33 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:08:33 user nova-compute[75813]:     </rng>
Nov 15 13:08:33 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:08:33 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:08:33 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:08:33 user nova-compute[75813]:     </memballoon>
Nov 15 13:08:33 user nova-compute[75813]:   </devices>
Nov 15 13:08:33 user nova-compute[75813]: </domain>
Nov 15 13:08:33 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T13:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-781384000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-781384000',id=30,image_ref='babe3620-24a1-4456-8164-4260c8414163',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1610888735',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-5d7gag7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member',shelved_at='2023-11-15T13:06:37.994323',shelved_host='user',shelved_image_id='babe3620-24a1-4456-8164-4260c8414163'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:08:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=b74022f2-55af-4eb7-81e0-4696fefd5ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG os_vif [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '476b65c7-73f7-5a53-9371-8cea333be623', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76c7059b-cb, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76c7059b-cb, col_values=(('qos', UUID('a72d1188-4b62-4ac1-9751-253c2cb6c97e')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76c7059b-cb, col_values=(('external_ids', {'iface-id': '76c7059b-cb68-4832-940f-9832e339c26c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:23:56', 'vm-uuid': 'b74022f2-55af-4eb7-81e0-4696fefd5ae5'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:33 user nova-compute[75813]: INFO os_vif [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb')
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:08:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] No VIF found with MAC fa:16:3e:b6:23:56, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:08:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-f5d0527b-2842-48ec-b376-5dbfade7ea44 req-c4a42fd7-357e-4b4e-94ef-4b1091d2b13c service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:08:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f5d0527b-2842-48ec-b376-5dbfade7ea44 req-c4a42fd7-357e-4b4e-94ef-4b1091d2b13c service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f5d0527b-2842-48ec-b376-5dbfade7ea44 req-c4a42fd7-357e-4b4e-94ef-4b1091d2b13c service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f5d0527b-2842-48ec-b376-5dbfade7ea44 req-c4a42fd7-357e-4b4e-94ef-4b1091d2b13c service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-f5d0527b-2842-48ec-b376-5dbfade7ea44 req-c4a42fd7-357e-4b4e-94ef-4b1091d2b13c service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:08:35 user nova-compute[75813]: WARNING nova.compute.manager [req-f5d0527b-2842-48ec-b376-5dbfade7ea44 req-c4a42fd7-357e-4b4e-94ef-4b1091d2b13c service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received unexpected event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 13:08:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "1c2e968d-90ed-43b5-b54a-157fbe05b745" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:35 user nova-compute[75813]: DEBUG nova.compute.manager [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:08:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:08:36 user nova-compute[75813]: INFO nova.compute.claims [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Claim successful on node user
Nov 15 13:08:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:36 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:08:36 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:08:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:36 user nova-compute[75813]: DEBUG nova.compute.manager [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:08:36 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:08:36 user nova-compute[75813]: DEBUG nova.compute.manager [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:08:36 user nova-compute[75813]: DEBUG nova.network.neutron [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:08:36 user nova-compute[75813]: DEBUG nova.compute.manager [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:08:36 user nova-compute[75813]: INFO nova.virt.block_device [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Booting with volume snapshot a6e912f3-ac7b-4261-81bc-17e1917c082c at /dev/vda
Nov 15 13:08:36 user nova-compute[75813]: DEBUG nova.policy [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bc41f21cddc40e7a287b6f809233a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63086918b1c84a608c4a5aebf968eab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:08:37 user nova-compute[75813]: DEBUG nova.network.neutron [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Successfully created port: ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:08:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-d0b908de-3359-4b30-a79c-480ab6bb64fa req-d60110d5-39ec-423e-a1e8-ee1a0d276231 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:08:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d0b908de-3359-4b30-a79c-480ab6bb64fa req-d60110d5-39ec-423e-a1e8-ee1a0d276231 service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d0b908de-3359-4b30-a79c-480ab6bb64fa req-d60110d5-39ec-423e-a1e8-ee1a0d276231 service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d0b908de-3359-4b30-a79c-480ab6bb64fa req-d60110d5-39ec-423e-a1e8-ee1a0d276231 service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-d0b908de-3359-4b30-a79c-480ab6bb64fa req-d60110d5-39ec-423e-a1e8-ee1a0d276231 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:08:37 user nova-compute[75813]: WARNING nova.compute.manager [req-d0b908de-3359-4b30-a79c-480ab6bb64fa req-d60110d5-39ec-423e-a1e8-ee1a0d276231 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received unexpected event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 13:08:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:08:37 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:08:37 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Instance spawned successfully.
Nov 15 13:08:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f37265c7-a55d-448f-b84b-c07ad5de5d6b tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.599s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG nova.network.neutron [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Successfully updated port: ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "refresh_cache-1c2e968d-90ed-43b5-b54a-157fbe05b745" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquired lock "refresh_cache-1c2e968d-90ed-43b5-b54a-157fbe05b745" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG nova.network.neutron [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-5e6b8e64-c7af-40fe-b015-83446275420b req-4b70eaae-368b-4cf9-9c68-708c08049987 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Received event network-changed-ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-5e6b8e64-c7af-40fe-b015-83446275420b req-4b70eaae-368b-4cf9-9c68-708c08049987 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Refreshing instance network info cache due to event network-changed-ac31f66f-d357-4a73-86ab-095fc363ffdd. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5e6b8e64-c7af-40fe-b015-83446275420b req-4b70eaae-368b-4cf9-9c68-708c08049987 service nova] Acquiring lock "refresh_cache-1c2e968d-90ed-43b5-b54a-157fbe05b745" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG nova.network.neutron [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG nova.network.neutron [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Updating instance_info_cache with network_info: [{"id": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "address": "fa:16:3e:1f:5d:5f", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac31f66f-d3", "ovs_interfaceid": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Releasing lock "refresh_cache-1c2e968d-90ed-43b5-b54a-157fbe05b745" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Instance network_info: |[{"id": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "address": "fa:16:3e:1f:5d:5f", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac31f66f-d3", "ovs_interfaceid": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5e6b8e64-c7af-40fe-b015-83446275420b req-4b70eaae-368b-4cf9-9c68-708c08049987 service nova] Acquired lock "refresh_cache-1c2e968d-90ed-43b5-b54a-157fbe05b745" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG nova.network.neutron [req-5e6b8e64-c7af-40fe-b015-83446275420b req-4b70eaae-368b-4cf9-9c68-708c08049987 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Refreshing network info cache for port ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG nova.network.neutron [req-5e6b8e64-c7af-40fe-b015-83446275420b req-4b70eaae-368b-4cf9-9c68-708c08049987 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Updated VIF entry in instance network info cache for port ac31f66f-d357-4a73-86ab-095fc363ffdd. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG nova.network.neutron [req-5e6b8e64-c7af-40fe-b015-83446275420b req-4b70eaae-368b-4cf9-9c68-708c08049987 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Updating instance_info_cache with network_info: [{"id": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "address": "fa:16:3e:1f:5d:5f", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac31f66f-d3", "ovs_interfaceid": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:08:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5e6b8e64-c7af-40fe-b015-83446275420b req-4b70eaae-368b-4cf9-9c68-708c08049987 service nova] Releasing lock "refresh_cache-1c2e968d-90ed-43b5-b54a-157fbe05b745" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:08:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG os_brick.utils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf72dfe5-5e39-4ecb-a48a-021748d596ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c7aa69-b9d7-4dec-b7bd-c4cec641ef50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cf1c26-879c-4b0c-95d9-9eed0b959c0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b13bdce-9fe3-421c-b085-894b3dc5252a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:08:42 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:08:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b2f3ee-db39-4f45-a2ea-e720e9f51ec4]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG os_brick.utils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:08:42 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Updating existing volume attachment record: f590e7d2-4896-4940-81af-386212933404 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:08:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75813) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:08:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Creating image(s)
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Ensure instance console log exists: /opt/stack/data/nova/instances/1c2e968d-90ed-43b5-b54a-157fbe05b745/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Start _get_guest_xml network_info=[{"id": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "address": "fa:16:3e:1f:5d:5f", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac31f66f-d3", "ovs_interfaceid": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T13:08:31Z,direct_url=<?>,disk_format='qcow2',id=49d73345-c951-48c8-a8df-cef693d2d38c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-137305652',owner='63086918b1c84a608c4a5aebf968eab5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T13:08:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'f590e7d2-4896-4940-81af-386212933404', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nULDiMhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c2e968d-90ed-43b5-b54a-157fbe05b745', 'attached_at': '', 'detached_at': '', 'volume_id': '5fc94d5a-f771-4011-aa6d-7607de1a7303', 'serial': '5fc94d5a-f771-4011-aa6d-7607de1a7303'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:08:47 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:08:47 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T13:08:31Z,direct_url=<?>,disk_format='qcow2',id=49d73345-c951-48c8-a8df-cef693d2d38c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-137305652',owner='63086918b1c84a608c4a5aebf968eab5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T13:08:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nULDiMhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:08:47 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:08:47 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:08:47 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8948a129-29c4-43b3-b042-e128678f6608]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:08:47 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fcf003-0bbe-47d3-819e-c5a7a4bbb29f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303] added
Nov 15 13:08:47 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc467c23-47cc-48cf-8b2f-349c6303f3f0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.069s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[935b3e27-e746-41f7-8006-f375c17ccc36]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nULDiMhQ {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nULDiMhQ" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0121feab-6025-4bbf-ba22-009b87bfc776]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nULDiMhQ'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd23f1d-0a59-48df-9850-2ad38110bee8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ab1063-69ae-4d1c-828c-83244c165a25]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:08:47 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:08:47 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:08:47 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:08:47 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb7523d-d92b-45bc-b674-3676530a06c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303, portal: 172.16.0.220,3260]
Nov 15 13:08:47 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303, portal: 172.16.0.220,3260] successful.
Nov 15 13:08:47 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dca651-8915-4784-a708-aae7c975aec5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[944db911-7483-47a0-b688-552cbe326d03]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:08:47 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:08:47 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:08:47 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:08:47 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:08:47 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:08:47 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83f25b7-fe09-4f95-8106-95cc021f0e21]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:08:47 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nULDiMhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:08:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:08:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '26437383363356331', 'path': '/dev/sdd'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:08:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437383363356331', 'path': '/dev/sdd'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-410593620',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-410593620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-410593620',id=36,image_ref='49d73345-c951-48c8-a8df-cef693d2d38c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp3FgHh9MzoDIfFhfFTZnG1VtrDbMT6lVPVqzRUlDt47BKC1f2ZIKeitmgUbqzPy267DmE9qvqCbQWxmDx5HxaApaVrxtYUA6O07RBf8fZLiHx3E8StldJSb9pmkvbeaQ==',key_name='tempest-keypair-998247238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-329szqtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-678819035',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=1c2e968d-90ed-43b5-b54a-157fbe05b745,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "address": "fa:16:3e:1f:5d:5f", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac31f66f-d3", "ovs_interfaceid": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "address": "fa:16:3e:1f:5d:5f", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac31f66f-d3", "ovs_interfaceid": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ac31f66f-d357-4a73-86ab-095fc363ffdd,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac31f66f-d3') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG nova.objects.instance [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c2e968d-90ed-43b5-b54a-157fbe05b745 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:08:49 user nova-compute[75813]:   <uuid>1c2e968d-90ed-43b5-b54a-157fbe05b745</uuid>
Nov 15 13:08:49 user nova-compute[75813]:   <name>instance-00000024</name>
Nov 15 13:08:49 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:08:49 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:08:49 user nova-compute[75813]:   <metadata>
Nov 15 13:08:49 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:08:49 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:08:49 user nova-compute[75813]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-410593620</nova:name>
Nov 15 13:08:49 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:08:47</nova:creationTime>
Nov 15 13:08:49 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:08:49 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:08:49 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:08:49 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:08:49 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:08:49 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:08:49 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:08:49 user nova-compute[75813]:       <nova:owner>
Nov 15 13:08:49 user nova-compute[75813]:         <nova:user uuid="3bc41f21cddc40e7a287b6f809233a65">tempest-TestVolumeBootPattern-678819035-project-member</nova:user>
Nov 15 13:08:49 user nova-compute[75813]:         <nova:project uuid="63086918b1c84a608c4a5aebf968eab5">tempest-TestVolumeBootPattern-678819035</nova:project>
Nov 15 13:08:49 user nova-compute[75813]:       </nova:owner>
Nov 15 13:08:49 user nova-compute[75813]:       <nova:root type="image" uuid="49d73345-c951-48c8-a8df-cef693d2d38c"/>
Nov 15 13:08:49 user nova-compute[75813]:       <nova:ports>
Nov 15 13:08:49 user nova-compute[75813]:         <nova:port uuid="ac31f66f-d357-4a73-86ab-095fc363ffdd">
Nov 15 13:08:49 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 13:08:49 user nova-compute[75813]:         </nova:port>
Nov 15 13:08:49 user nova-compute[75813]:       </nova:ports>
Nov 15 13:08:49 user nova-compute[75813]:     </nova:instance>
Nov 15 13:08:49 user nova-compute[75813]:   </metadata>
Nov 15 13:08:49 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:08:49 user nova-compute[75813]:     <system>
Nov 15 13:08:49 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:08:49 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:08:49 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:08:49 user nova-compute[75813]:       <entry name="serial">1c2e968d-90ed-43b5-b54a-157fbe05b745</entry>
Nov 15 13:08:49 user nova-compute[75813]:       <entry name="uuid">1c2e968d-90ed-43b5-b54a-157fbe05b745</entry>
Nov 15 13:08:49 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:08:49 user nova-compute[75813]:     </system>
Nov 15 13:08:49 user nova-compute[75813]:   </sysinfo>
Nov 15 13:08:49 user nova-compute[75813]:   <os>
Nov 15 13:08:49 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:08:49 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:08:49 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:08:49 user nova-compute[75813]:   </os>
Nov 15 13:08:49 user nova-compute[75813]:   <features>
Nov 15 13:08:49 user nova-compute[75813]:     <acpi/>
Nov 15 13:08:49 user nova-compute[75813]:     <apic/>
Nov 15 13:08:49 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:08:49 user nova-compute[75813]:   </features>
Nov 15 13:08:49 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:08:49 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:08:49 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:08:49 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:08:49 user nova-compute[75813]:   </clock>
Nov 15 13:08:49 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:08:49 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:08:49 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:08:49 user nova-compute[75813]:   </cpu>
Nov 15 13:08:49 user nova-compute[75813]:   <devices>
Nov 15 13:08:49 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:08:49 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:08:49 user nova-compute[75813]:       <source dev="/dev/sdd"/>
Nov 15 13:08:49 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:08:49 user nova-compute[75813]:       <serial>5fc94d5a-f771-4011-aa6d-7607de1a7303</serial>
Nov 15 13:08:49 user nova-compute[75813]:     </disk>
Nov 15 13:08:49 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:08:49 user nova-compute[75813]:       <mac address="fa:16:3e:1f:5d:5f"/>
Nov 15 13:08:49 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:08:49 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:08:49 user nova-compute[75813]:       <target dev="tapac31f66f-d3"/>
Nov 15 13:08:49 user nova-compute[75813]:     </interface>
Nov 15 13:08:49 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:08:49 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/1c2e968d-90ed-43b5-b54a-157fbe05b745/console.log" append="off"/>
Nov 15 13:08:49 user nova-compute[75813]:     </serial>
Nov 15 13:08:49 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:08:49 user nova-compute[75813]:     <video>
Nov 15 13:08:49 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:08:49 user nova-compute[75813]:     </video>
Nov 15 13:08:49 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:08:49 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:08:49 user nova-compute[75813]:     </rng>
Nov 15 13:08:49 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:08:49 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:08:49 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:08:49 user nova-compute[75813]:     </memballoon>
Nov 15 13:08:49 user nova-compute[75813]:   </devices>
Nov 15 13:08:49 user nova-compute[75813]: </domain>
Nov 15 13:08:49 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-410593620',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-410593620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-410593620',id=36,image_ref='49d73345-c951-48c8-a8df-cef693d2d38c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp3FgHh9MzoDIfFhfFTZnG1VtrDbMT6lVPVqzRUlDt47BKC1f2ZIKeitmgUbqzPy267DmE9qvqCbQWxmDx5HxaApaVrxtYUA6O07RBf8fZLiHx3E8StldJSb9pmkvbeaQ==',key_name='tempest-keypair-998247238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-329szqtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-678819035',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=1c2e968d-90ed-43b5-b54a-157fbe05b745,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "address": "fa:16:3e:1f:5d:5f", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac31f66f-d3", "ovs_interfaceid": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "address": "fa:16:3e:1f:5d:5f", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac31f66f-d3", "ovs_interfaceid": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ac31f66f-d357-4a73-86ab-095fc363ffdd,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac31f66f-d3') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG os_vif [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ac31f66f-d357-4a73-86ab-095fc363ffdd,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac31f66f-d3') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0998e620-d859-5312-93ad-7bc1227cd866', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac31f66f-d3, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac31f66f-d3, col_values=(('qos', UUID('8b3646bf-1a24-40c4-9caf-cd881fb4a988')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac31f66f-d3, col_values=(('external_ids', {'iface-id': 'ac31f66f-d357-4a73-86ab-095fc363ffdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:5d:5f', 'vm-uuid': '1c2e968d-90ed-43b5-b54a-157fbe05b745'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:49 user nova-compute[75813]: INFO os_vif [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ac31f66f-d357-4a73-86ab-095fc363ffdd,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac31f66f-d3')
Nov 15 13:08:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:08:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No VIF found with MAC fa:16:3e:1f:5d:5f, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:08:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-5c112239-6236-43af-bd75-5542e3aef7e8 req-d7f95740-cbae-49a5-a5f3-4536e8d41a1c service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Received event network-vif-plugged-ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:08:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c112239-6236-43af-bd75-5542e3aef7e8 req-d7f95740-cbae-49a5-a5f3-4536e8d41a1c service nova] Acquiring lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c112239-6236-43af-bd75-5542e3aef7e8 req-d7f95740-cbae-49a5-a5f3-4536e8d41a1c service nova] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c112239-6236-43af-bd75-5542e3aef7e8 req-d7f95740-cbae-49a5-a5f3-4536e8d41a1c service nova] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-5c112239-6236-43af-bd75-5542e3aef7e8 req-d7f95740-cbae-49a5-a5f3-4536e8d41a1c service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] No waiting events found dispatching network-vif-plugged-ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:08:50 user nova-compute[75813]: WARNING nova.compute.manager [req-5c112239-6236-43af-bd75-5542e3aef7e8 req-d7f95740-cbae-49a5-a5f3-4536e8d41a1c service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Received unexpected event network-vif-plugged-ac31f66f-d357-4a73-86ab-095fc363ffdd for instance with vm_state building and task_state spawning.
Nov 15 13:08:51 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:08:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:08:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:08:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:08:51 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:08:51 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updating instance_info_cache with network_info: [{"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:08:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:08:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:08:51 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:08:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 13:08:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] There are 0 instances to clean {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 13:08:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:08:52 user nova-compute[75813]: DEBUG nova.compute.manager [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:08:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:08:52 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Instance spawned successfully.
Nov 15 13:08:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:08:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:08:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:08:52 user nova-compute[75813]: INFO nova.compute.manager [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 15 13:08:52 user nova-compute[75813]: DEBUG nova.compute.manager [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:08:52 user nova-compute[75813]: INFO nova.compute.manager [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Took 16.63 seconds to build instance.
Nov 15 13:08:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-60f1a354-baec-4e6f-b41b-f2366f2fbb0c tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.740s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-27f42d27-709a-4bf4-aaae-aada8762e590 req-1e505809-947d-461e-86dc-c6280fd9729b service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Received event network-vif-plugged-ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:08:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-27f42d27-709a-4bf4-aaae-aada8762e590 req-1e505809-947d-461e-86dc-c6280fd9729b service nova] Acquiring lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-27f42d27-709a-4bf4-aaae-aada8762e590 req-1e505809-947d-461e-86dc-c6280fd9729b service nova] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-27f42d27-709a-4bf4-aaae-aada8762e590 req-1e505809-947d-461e-86dc-c6280fd9729b service nova] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-27f42d27-709a-4bf4-aaae-aada8762e590 req-1e505809-947d-461e-86dc-c6280fd9729b service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] No waiting events found dispatching network-vif-plugged-ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:08:52 user nova-compute[75813]: WARNING nova.compute.manager [req-27f42d27-709a-4bf4-aaae-aada8762e590 req-1e505809-947d-461e-86dc-c6280fd9729b service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Received unexpected event network-vif-plugged-ac31f66f-d357-4a73-86ab-095fc363ffdd for instance with vm_state active and task_state None.
Nov 15 13:08:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:08:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:08:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:55 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:08:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:57 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:08:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:09:00 user nova-compute[75813]: INFO nova.compute.claims [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Claim successful on node user
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Refreshing inventories for resource provider 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Updating ProviderTree inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Refreshing aggregate associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, aggregates: None {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Refreshing trait associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, traits: HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:00 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.015s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:09:01 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:09:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:01 user nova-compute[75813]: INFO nova.virt.block_device [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Booting with volume-backed-image 4d13142f-f571-4806-9713-890c0afeb458 at /dev/vda
Nov 15 13:09:01 user nova-compute[75813]: DEBUG nova.policy [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07f52b120c2e46e2a8ca7eb83dafceca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '134cc574095942efb38b85068bc72bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Successfully created port: 5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Successfully updated port: 5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-478b27fe-8f66-46bd-b8b3-3d363a48ca4e req-e1b1eeb1-ff0e-473f-a6a5-1e05f94445ad service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-changed-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-478b27fe-8f66-46bd-b8b3-3d363a48ca4e req-e1b1eeb1-ff0e-473f-a6a5-1e05f94445ad service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Refreshing instance network info cache due to event network-changed-5224c182-a272-4ff3-86b6-780e6f0f7593. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-478b27fe-8f66-46bd-b8b3-3d363a48ca4e req-e1b1eeb1-ff0e-473f-a6a5-1e05f94445ad service nova] Acquiring lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-478b27fe-8f66-46bd-b8b3-3d363a48ca4e req-e1b1eeb1-ff0e-473f-a6a5-1e05f94445ad service nova] Acquired lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG nova.network.neutron [req-478b27fe-8f66-46bd-b8b3-3d363a48ca4e req-e1b1eeb1-ff0e-473f-a6a5-1e05f94445ad service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Refreshing network info cache for port 5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:09:02 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:09:02 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:09:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7972MB free_disk=24.909019470214844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-478b27fe-8f66-46bd-b8b3-3d363a48ca4e req-e1b1eeb1-ff0e-473f-a6a5-1e05f94445ad service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca153542-ced0-4884-827f-7af9517b6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance b74022f2-55af-4eb7-81e0-4696fefd5ae5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 1c2e968d-90ed-43b5-b54a-157fbe05b745 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 25669d63-7812-4e4c-a4ed-0e30f7515510 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-478b27fe-8f66-46bd-b8b3-3d363a48ca4e req-e1b1eeb1-ff0e-473f-a6a5-1e05f94445ad service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-478b27fe-8f66-46bd-b8b3-3d363a48ca4e req-e1b1eeb1-ff0e-473f-a6a5-1e05f94445ad service nova] Releasing lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquired lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Updating instance_info_cache with network_info: [{"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Releasing lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Instance network_info: |[{"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.667s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:03 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:09:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:09:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:09:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG os_brick.utils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[37729a5c-2bdc-4436-84a2-fea12726f801]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[788c52ab-8dfa-4210-91b4-53a77f4d9059]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98ea511-b018-4a36-befb-479e7271e2a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04861f1-11e1-4314-be37-c56e1a92e0a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:09:07 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:09:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be8185f-6a09-4ac0-afbe-9a0e1d00f04b]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG os_brick.utils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:09:07 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Updating existing volume attachment record: df714670-d9e3-4420-a411-49b2ea7d591c {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:09:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:09:12 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Creating image(s)
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Ensure instance console log exists: /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Start _get_guest_xml network_info=[{"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'df714670-d9e3-4420-a411-49b2ea7d591c', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVrKRgcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '25669d63-7812-4e4c-a4ed-0e30f7515510', 'attached_at': '', 'detached_at': '', 'volume_id': '6ba5cb91-40de-4cee-8dde-89cf61962f89', 'serial': '6ba5cb91-40de-4cee-8dde-89cf61962f89'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:09:12 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:09:12 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVrKRgcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:09:12 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:09:12 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:09:12 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea7438f-9335-4219-9f38-1a6ec1adcf9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:09:12 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[923bdfe9-933b-4c2d-8cbe-6c7233edb094]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89] added
Nov 15 13:09:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abd3d8f-347c-4850-8ed7-3540ee70fce7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be64f51-b917-4626-9df6-95af549872a9]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVrKRgcQ {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVrKRgcQ" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c425cc-6f38-47c8-a0d2-780227b978df]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HVrKRgcQ'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f69fa5f-f762-43f9-a468-8a1711d02855]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbe047b-b27c-438e-b220-2ec5c3e67d53]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:12 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:12 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:12 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:12 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92d52c6-b537-4a39-a7ba-47e08c47db9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89, portal: 172.16.0.220,3260]
Nov 15 13:09:12 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89, portal: 172.16.0.220,3260] successful.
Nov 15 13:09:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c1b50d-de38-4e7e-9e1c-82626b9fd1d3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3a2b5d-0091-4cbc-b442-59c227387eee]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:12 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:12 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:12 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:12 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:12 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:12 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e54641-a708-4271-a072-365dff1bac5c]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:09:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVrKRgcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26561306635613234', 'path': '/dev/sde'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561306635613234', 'path': '/dev/sde'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2032798804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2032798804',id=37,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-bby005p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:09:01Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=25669d63-7812-4e4c-a4ed-0e30f7515510,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=5224c182-a272-4ff3-86b6-780e6f0f7593,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5224c182-a2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG nova.objects.instance [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'pci_devices' on Instance uuid 25669d63-7812-4e4c-a4ed-0e30f7515510 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:09:13 user nova-compute[75813]:   <uuid>25669d63-7812-4e4c-a4ed-0e30f7515510</uuid>
Nov 15 13:09:13 user nova-compute[75813]:   <name>instance-00000025</name>
Nov 15 13:09:13 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:09:13 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:09:13 user nova-compute[75813]:   <metadata>
Nov 15 13:09:13 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:09:13 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:09:13 user nova-compute[75813]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2032798804</nova:name>
Nov 15 13:09:13 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:09:12</nova:creationTime>
Nov 15 13:09:13 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:09:13 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:09:13 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:09:13 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:09:13 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:09:13 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:09:13 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:09:13 user nova-compute[75813]:       <nova:owner>
Nov 15 13:09:13 user nova-compute[75813]:         <nova:user uuid="07f52b120c2e46e2a8ca7eb83dafceca">tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member</nova:user>
Nov 15 13:09:13 user nova-compute[75813]:         <nova:project uuid="134cc574095942efb38b85068bc72bfe">tempest-ServerBootFromVolumeStableRescueTest-2006280819</nova:project>
Nov 15 13:09:13 user nova-compute[75813]:       </nova:owner>
Nov 15 13:09:13 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:09:13 user nova-compute[75813]:       <nova:ports>
Nov 15 13:09:13 user nova-compute[75813]:         <nova:port uuid="5224c182-a272-4ff3-86b6-780e6f0f7593">
Nov 15 13:09:13 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 13:09:13 user nova-compute[75813]:         </nova:port>
Nov 15 13:09:13 user nova-compute[75813]:       </nova:ports>
Nov 15 13:09:13 user nova-compute[75813]:     </nova:instance>
Nov 15 13:09:13 user nova-compute[75813]:   </metadata>
Nov 15 13:09:13 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:09:13 user nova-compute[75813]:     <system>
Nov 15 13:09:13 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:09:13 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:09:13 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:09:13 user nova-compute[75813]:       <entry name="serial">25669d63-7812-4e4c-a4ed-0e30f7515510</entry>
Nov 15 13:09:13 user nova-compute[75813]:       <entry name="uuid">25669d63-7812-4e4c-a4ed-0e30f7515510</entry>
Nov 15 13:09:13 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:09:13 user nova-compute[75813]:     </system>
Nov 15 13:09:13 user nova-compute[75813]:   </sysinfo>
Nov 15 13:09:13 user nova-compute[75813]:   <os>
Nov 15 13:09:13 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:09:13 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:09:13 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:09:13 user nova-compute[75813]:   </os>
Nov 15 13:09:13 user nova-compute[75813]:   <features>
Nov 15 13:09:13 user nova-compute[75813]:     <acpi/>
Nov 15 13:09:13 user nova-compute[75813]:     <apic/>
Nov 15 13:09:13 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:09:13 user nova-compute[75813]:   </features>
Nov 15 13:09:13 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:09:13 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:09:13 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:09:13 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:09:13 user nova-compute[75813]:   </clock>
Nov 15 13:09:13 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:09:13 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:09:13 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:09:13 user nova-compute[75813]:   </cpu>
Nov 15 13:09:13 user nova-compute[75813]:   <devices>
Nov 15 13:09:13 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:09:13 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:09:13 user nova-compute[75813]:       <source dev="/dev/sde"/>
Nov 15 13:09:13 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:09:13 user nova-compute[75813]:       <serial>6ba5cb91-40de-4cee-8dde-89cf61962f89</serial>
Nov 15 13:09:13 user nova-compute[75813]:     </disk>
Nov 15 13:09:13 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:09:13 user nova-compute[75813]:       <mac address="fa:16:3e:c1:6c:5b"/>
Nov 15 13:09:13 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:09:13 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:09:13 user nova-compute[75813]:       <target dev="tap5224c182-a2"/>
Nov 15 13:09:13 user nova-compute[75813]:     </interface>
Nov 15 13:09:13 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:09:13 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/console.log" append="off"/>
Nov 15 13:09:13 user nova-compute[75813]:     </serial>
Nov 15 13:09:13 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:09:13 user nova-compute[75813]:     <video>
Nov 15 13:09:13 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:09:13 user nova-compute[75813]:     </video>
Nov 15 13:09:13 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:09:13 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:09:13 user nova-compute[75813]:     </rng>
Nov 15 13:09:13 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:09:13 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:09:13 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:09:13 user nova-compute[75813]:     </memballoon>
Nov 15 13:09:13 user nova-compute[75813]:   </devices>
Nov 15 13:09:13 user nova-compute[75813]: </domain>
Nov 15 13:09:13 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2032798804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2032798804',id=37,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-bby005p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:09:01Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=25669d63-7812-4e4c-a4ed-0e30f7515510,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=5224c182-a272-4ff3-86b6-780e6f0f7593,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5224c182-a2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG os_vif [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=5224c182-a272-4ff3-86b6-780e6f0f7593,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5224c182-a2') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5086b6e-b7de-5baf-8809-105bef097300', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5224c182-a2, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5224c182-a2, col_values=(('qos', UUID('82eeb4c1-16d2-4561-b6cd-8180e7660153')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5224c182-a2, col_values=(('external_ids', {'iface-id': '5224c182-a272-4ff3-86b6-780e6f0f7593', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:6c:5b', 'vm-uuid': '25669d63-7812-4e4c-a4ed-0e30f7515510'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:13 user nova-compute[75813]: INFO os_vif [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=5224c182-a272-4ff3-86b6-780e6f0f7593,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5224c182-a2')
Nov 15 13:09:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:09:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No VIF found with MAC fa:16:3e:c1:6c:5b, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:09:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-a723a6f7-9be4-4a6b-8c6d-2f93632ec39e req-88231049-d370-4016-93bb-d2ff2e516bf2 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:09:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a723a6f7-9be4-4a6b-8c6d-2f93632ec39e req-88231049-d370-4016-93bb-d2ff2e516bf2 service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a723a6f7-9be4-4a6b-8c6d-2f93632ec39e req-88231049-d370-4016-93bb-d2ff2e516bf2 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a723a6f7-9be4-4a6b-8c6d-2f93632ec39e req-88231049-d370-4016-93bb-d2ff2e516bf2 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-a723a6f7-9be4-4a6b-8c6d-2f93632ec39e req-88231049-d370-4016-93bb-d2ff2e516bf2 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:09:14 user nova-compute[75813]: WARNING nova.compute.manager [req-a723a6f7-9be4-4a6b-8c6d-2f93632ec39e req-88231049-d370-4016-93bb-d2ff2e516bf2 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received unexpected event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with vm_state building and task_state spawning.
Nov 15 13:09:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:09:16 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Instance spawned successfully.
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:16 user nova-compute[75813]: INFO nova.compute.manager [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-57dfe170-9d54-41db-8ca8-d5ad04fa258d req-da575805-762c-4cf5-8557-74f4783ce219 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-57dfe170-9d54-41db-8ca8-d5ad04fa258d req-da575805-762c-4cf5-8557-74f4783ce219 service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-57dfe170-9d54-41db-8ca8-d5ad04fa258d req-da575805-762c-4cf5-8557-74f4783ce219 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-57dfe170-9d54-41db-8ca8-d5ad04fa258d req-da575805-762c-4cf5-8557-74f4783ce219 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-57dfe170-9d54-41db-8ca8-d5ad04fa258d req-da575805-762c-4cf5-8557-74f4783ce219 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:09:16 user nova-compute[75813]: WARNING nova.compute.manager [req-57dfe170-9d54-41db-8ca8-d5ad04fa258d req-da575805-762c-4cf5-8557-74f4783ce219 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received unexpected event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with vm_state building and task_state spawning.
Nov 15 13:09:17 user nova-compute[75813]: INFO nova.compute.manager [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Took 16.94 seconds to build instance.
Nov 15 13:09:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b199d9ab-6109-4f3d-9579-ec44c9921118 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.077s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:09:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:09:20 user nova-compute[75813]: INFO nova.compute.claims [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Claim successful on node user
Nov 15 13:09:20 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:09:20 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:09:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG nova.network.neutron [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:09:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:09:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG nova.policy [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2b3f74a69954ecf8d5cce188f5fc043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ae639fa3444ba0be3d480b8572a0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:09:21 user nova-compute[75813]: INFO nova.virt.block_device [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Booting with volume 33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de at /dev/vda
Nov 15 13:09:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG os_brick.utils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4334579d-73a4-47d6-907c-fa3ccfd54e12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[53edc675-9e04-4328-93c0-1c2982fb1191]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b30956-4efe-49c9-af86-4b2710a8005a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae57772b-6da9-4776-aacf-2d990572ee72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:09:21 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:09:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5647acde-8b2c-4cf0-89da-8b95ea9c8930]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG os_brick.utils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updating existing volume attachment record: 1b2fd39e-4a08-47e0-b1a2-e8ff59c7a075 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:09:21 user nova-compute[75813]: DEBUG nova.network.neutron [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Successfully created port: ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG nova.network.neutron [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Successfully updated port: ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquired lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG nova.network.neutron [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-ae6b56d6-be74-49b5-8d5a-4821e5bcb315 req-12749818-1db1-430c-af6a-357d70fa068c service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-changed-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-ae6b56d6-be74-49b5-8d5a-4821e5bcb315 req-12749818-1db1-430c-af6a-357d70fa068c service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Refreshing instance network info cache due to event network-changed-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ae6b56d6-be74-49b5-8d5a-4821e5bcb315 req-12749818-1db1-430c-af6a-357d70fa068c service nova] Acquiring lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG nova.network.neutron [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG nova.network.neutron [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updating instance_info_cache with network_info: [{"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Releasing lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG nova.compute.manager [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Instance network_info: |[{"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ae6b56d6-be74-49b5-8d5a-4821e5bcb315 req-12749818-1db1-430c-af6a-357d70fa068c service nova] Acquired lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG nova.network.neutron [req-ae6b56d6-be74-49b5-8d5a-4821e5bcb315 req-12749818-1db1-430c-af6a-357d70fa068c service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Refreshing network info cache for port ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG nova.network.neutron [req-ae6b56d6-be74-49b5-8d5a-4821e5bcb315 req-12749818-1db1-430c-af6a-357d70fa068c service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updated VIF entry in instance network info cache for port ccf18cc9-6aa6-4822-b7e4-e7f635a34e78. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG nova.network.neutron [req-ae6b56d6-be74-49b5-8d5a-4821e5bcb315 req-12749818-1db1-430c-af6a-357d70fa068c service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updating instance_info_cache with network_info: [{"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:09:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ae6b56d6-be74-49b5-8d5a-4821e5bcb315 req-12749818-1db1-430c-af6a-357d70fa068c service nova] Releasing lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:09:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.compute.manager [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:09:26 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Creating image(s)
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Ensure instance console log exists: /opt/stack/data/nova/instances/83a338e2-b102-404b-9cbf-730a62aa7e53/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Start _get_guest_xml network_info=[{"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '1b2fd39e-4a08-47e0-b1a2-e8ff59c7a075', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiOkrRng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83a338e2-b102-404b-9cbf-730a62aa7e53', 'attached_at': '', 'detached_at': '', 'volume_id': '33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 'serial': '33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:09:26 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:09:26 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiOkrRng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:09:26 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:09:26 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:09:26 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabd39b7-bbf0-40f7-9f05-67154e7adaad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:09:26 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5315c9d7-4d26-46cd-86c7-218d4a72a724]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de] added
Nov 15 13:09:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b65857-3f0e-4b38-81f3-88784f8cf686]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f26d7ae-72f7-4637-9023-e296a9690af5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiOkrRng {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiOkrRng" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9ce154-7a74-49ad-8d73-be790453a031]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UiOkrRng'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c72a055-19d2-4596-ab31-7987fc0949df]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53b59a7-4309-46a8-a832-0df129164a2a]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd630509-5ef1-438e-8729-55c53ff54818]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260]
Nov 15 13:09:26 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260] successful.
Nov 15 13:09:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb53de07-61b9-432f-8ba2-e174b2a36326]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfe614c-d030-4bd6-93a0-0df7a0a01b80]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:09:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:26 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:09:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[10470996-398c-457a-bbba-59db93fa44b3]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:09:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiOkrRng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26232316639393030', 'path': '/dev/sdf'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232316639393030', 'path': '/dev/sdf'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1229970695',display_name='tempest-ServerActionsTestOtherA-server-1229970695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1229970695',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVScCZLXI8rlN2zoy2tMpAv6grzq+Q7BUD3jx/c9Ws+QNGWvOGcy9SrrC2M21ruqsJkGVx6GSsSkIbkFK6Q0lAtOU+eEFXMzxHts/+TJKb69Xyco0mKWaJkDc6A3DpPzg==',key_name='tempest-keypair-21661059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-g37n7g8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=83a338e2-b102-404b-9cbf-730a62aa7e53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG nova.objects.instance [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'pci_devices' on Instance uuid 83a338e2-b102-404b-9cbf-730a62aa7e53 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:09:27 user nova-compute[75813]:   <uuid>83a338e2-b102-404b-9cbf-730a62aa7e53</uuid>
Nov 15 13:09:27 user nova-compute[75813]:   <name>instance-00000026</name>
Nov 15 13:09:27 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:09:27 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:09:27 user nova-compute[75813]:   <metadata>
Nov 15 13:09:27 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:09:27 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:09:27 user nova-compute[75813]:       <nova:name>tempest-ServerActionsTestOtherA-server-1229970695</nova:name>
Nov 15 13:09:27 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:09:26</nova:creationTime>
Nov 15 13:09:27 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:09:27 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:09:27 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:09:27 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:09:27 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:09:27 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:09:27 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:09:27 user nova-compute[75813]:       <nova:owner>
Nov 15 13:09:27 user nova-compute[75813]:         <nova:user uuid="c2b3f74a69954ecf8d5cce188f5fc043">tempest-ServerActionsTestOtherA-1826218173-project-member</nova:user>
Nov 15 13:09:27 user nova-compute[75813]:         <nova:project uuid="76ae639fa3444ba0be3d480b8572a0e6">tempest-ServerActionsTestOtherA-1826218173</nova:project>
Nov 15 13:09:27 user nova-compute[75813]:       </nova:owner>
Nov 15 13:09:27 user nova-compute[75813]:       <nova:ports>
Nov 15 13:09:27 user nova-compute[75813]:         <nova:port uuid="ccf18cc9-6aa6-4822-b7e4-e7f635a34e78">
Nov 15 13:09:27 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 13:09:27 user nova-compute[75813]:         </nova:port>
Nov 15 13:09:27 user nova-compute[75813]:       </nova:ports>
Nov 15 13:09:27 user nova-compute[75813]:     </nova:instance>
Nov 15 13:09:27 user nova-compute[75813]:   </metadata>
Nov 15 13:09:27 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:09:27 user nova-compute[75813]:     <system>
Nov 15 13:09:27 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:09:27 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:09:27 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:09:27 user nova-compute[75813]:       <entry name="serial">83a338e2-b102-404b-9cbf-730a62aa7e53</entry>
Nov 15 13:09:27 user nova-compute[75813]:       <entry name="uuid">83a338e2-b102-404b-9cbf-730a62aa7e53</entry>
Nov 15 13:09:27 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:09:27 user nova-compute[75813]:     </system>
Nov 15 13:09:27 user nova-compute[75813]:   </sysinfo>
Nov 15 13:09:27 user nova-compute[75813]:   <os>
Nov 15 13:09:27 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:09:27 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:09:27 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:09:27 user nova-compute[75813]:   </os>
Nov 15 13:09:27 user nova-compute[75813]:   <features>
Nov 15 13:09:27 user nova-compute[75813]:     <acpi/>
Nov 15 13:09:27 user nova-compute[75813]:     <apic/>
Nov 15 13:09:27 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:09:27 user nova-compute[75813]:   </features>
Nov 15 13:09:27 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:09:27 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:09:27 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:09:27 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:09:27 user nova-compute[75813]:   </clock>
Nov 15 13:09:27 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:09:27 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:09:27 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:09:27 user nova-compute[75813]:   </cpu>
Nov 15 13:09:27 user nova-compute[75813]:   <devices>
Nov 15 13:09:27 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:09:27 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:09:27 user nova-compute[75813]:       <source dev="/dev/sdf"/>
Nov 15 13:09:27 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:09:27 user nova-compute[75813]:       <serial>33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de</serial>
Nov 15 13:09:27 user nova-compute[75813]:     </disk>
Nov 15 13:09:27 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:09:27 user nova-compute[75813]:       <mac address="fa:16:3e:1a:ca:82"/>
Nov 15 13:09:27 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:09:27 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:09:27 user nova-compute[75813]:       <target dev="tapccf18cc9-6a"/>
Nov 15 13:09:27 user nova-compute[75813]:     </interface>
Nov 15 13:09:27 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:09:27 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/83a338e2-b102-404b-9cbf-730a62aa7e53/console.log" append="off"/>
Nov 15 13:09:27 user nova-compute[75813]:     </serial>
Nov 15 13:09:27 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:09:27 user nova-compute[75813]:     <video>
Nov 15 13:09:27 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:09:27 user nova-compute[75813]:     </video>
Nov 15 13:09:27 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:09:27 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:09:27 user nova-compute[75813]:     </rng>
Nov 15 13:09:27 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:09:27 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:09:27 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:09:27 user nova-compute[75813]:     </memballoon>
Nov 15 13:09:27 user nova-compute[75813]:   </devices>
Nov 15 13:09:27 user nova-compute[75813]: </domain>
Nov 15 13:09:27 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1229970695',display_name='tempest-ServerActionsTestOtherA-server-1229970695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1229970695',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVScCZLXI8rlN2zoy2tMpAv6grzq+Q7BUD3jx/c9Ws+QNGWvOGcy9SrrC2M21ruqsJkGVx6GSsSkIbkFK6Q0lAtOU+eEFXMzxHts/+TJKb69Xyco0mKWaJkDc6A3DpPzg==',key_name='tempest-keypair-21661059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-g37n7g8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=83a338e2-b102-404b-9cbf-730a62aa7e53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG os_vif [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aee842aa-62a3-5b29-bf5a-74176f1e62cd', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccf18cc9-6a, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccf18cc9-6a, col_values=(('qos', UUID('23c88494-468e-46e4-84b2-572f6a66ec9d')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccf18cc9-6a, col_values=(('external_ids', {'iface-id': 'ccf18cc9-6aa6-4822-b7e4-e7f635a34e78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:ca:82', 'vm-uuid': '83a338e2-b102-404b-9cbf-730a62aa7e53'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:09:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:27 user nova-compute[75813]: INFO os_vif [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a')
Nov 15 13:09:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:09:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No VIF found with MAC fa:16:3e:1a:ca:82, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:09:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-fc2df847-5f60-4663-a9e1-616a60a44bda req-4f674a7c-389f-4b75-87da-8da9d4a3fb8d service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:09:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fc2df847-5f60-4663-a9e1-616a60a44bda req-4f674a7c-389f-4b75-87da-8da9d4a3fb8d service nova] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fc2df847-5f60-4663-a9e1-616a60a44bda req-4f674a7c-389f-4b75-87da-8da9d4a3fb8d service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fc2df847-5f60-4663-a9e1-616a60a44bda req-4f674a7c-389f-4b75-87da-8da9d4a3fb8d service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-fc2df847-5f60-4663-a9e1-616a60a44bda req-4f674a7c-389f-4b75-87da-8da9d4a3fb8d service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] No waiting events found dispatching network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:09:29 user nova-compute[75813]: WARNING nova.compute.manager [req-fc2df847-5f60-4663-a9e1-616a60a44bda req-4f674a7c-389f-4b75-87da-8da9d4a3fb8d service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received unexpected event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 for instance with vm_state building and task_state spawning.
Nov 15 13:09:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:09:31 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Instance spawned successfully.
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:09:31 user nova-compute[75813]: INFO nova.compute.manager [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:09:31 user nova-compute[75813]: INFO nova.compute.manager [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Took 11.23 seconds to build instance.
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-4cd61ee1-46ec-49fb-a502-acf890948fa5 req-637f3f45-cd2e-448d-bf4e-3709b1019117 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4cd61ee1-46ec-49fb-a502-acf890948fa5 req-637f3f45-cd2e-448d-bf4e-3709b1019117 service nova] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4cd61ee1-46ec-49fb-a502-acf890948fa5 req-637f3f45-cd2e-448d-bf4e-3709b1019117 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4cd61ee1-46ec-49fb-a502-acf890948fa5 req-637f3f45-cd2e-448d-bf4e-3709b1019117 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-4cd61ee1-46ec-49fb-a502-acf890948fa5 req-637f3f45-cd2e-448d-bf4e-3709b1019117 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] No waiting events found dispatching network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:09:31 user nova-compute[75813]: WARNING nova.compute.manager [req-4cd61ee1-46ec-49fb-a502-acf890948fa5 req-637f3f45-cd2e-448d-bf4e-3709b1019117 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received unexpected event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 for instance with vm_state active and task_state None.
Nov 15 13:09:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-09398399-5db6-4d14-b882-a09dba1b077d tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.336s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:34 user nova-compute[75813]: INFO nova.compute.manager [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Rescuing
Nov 15 13:09:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:09:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquired lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:09:34 user nova-compute[75813]: DEBUG nova.network.neutron [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG nova.network.neutron [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Updating instance_info_cache with network_info: [{"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Releasing lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-bb919929-b6f0-4779-a78a-4e19343e6b40 req-7e4fd24a-69d0-454e-a8dd-1fc45e1c5c4a service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Received event network-changed-c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-bb919929-b6f0-4779-a78a-4e19343e6b40 req-7e4fd24a-69d0-454e-a8dd-1fc45e1c5c4a service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Refreshing instance network info cache due to event network-changed-c111045e-8778-439e-ac12-ce8b5f2c58a3. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bb919929-b6f0-4779-a78a-4e19343e6b40 req-7e4fd24a-69d0-454e-a8dd-1fc45e1c5c4a service nova] Acquiring lock "refresh_cache-4eb83276-6ce5-44c1-bd80-95c9bcba1d52" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bb919929-b6f0-4779-a78a-4e19343e6b40 req-7e4fd24a-69d0-454e-a8dd-1fc45e1c5c4a service nova] Acquired lock "refresh_cache-4eb83276-6ce5-44c1-bd80-95c9bcba1d52" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG nova.network.neutron [req-bb919929-b6f0-4779-a78a-4e19343e6b40 req-7e4fd24a-69d0-454e-a8dd-1fc45e1c5c4a service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Refreshing network info cache for port c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-80e4c29a-5ff6-49e4-9913-6b92aba7af08 req-1cc9fdc9-6109-4946-8b75-8e58e64eec61 service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received event network-vif-unplugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-80e4c29a-5ff6-49e4-9913-6b92aba7af08 req-1cc9fdc9-6109-4946-8b75-8e58e64eec61 service nova] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-80e4c29a-5ff6-49e4-9913-6b92aba7af08 req-1cc9fdc9-6109-4946-8b75-8e58e64eec61 service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-80e4c29a-5ff6-49e4-9913-6b92aba7af08 req-1cc9fdc9-6109-4946-8b75-8e58e64eec61 service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-80e4c29a-5ff6-49e4-9913-6b92aba7af08 req-1cc9fdc9-6109-4946-8b75-8e58e64eec61 service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] No waiting events found dispatching network-vif-unplugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:09:35 user nova-compute[75813]: WARNING nova.compute.manager [req-80e4c29a-5ff6-49e4-9913-6b92aba7af08 req-1cc9fdc9-6109-4946-8b75-8e58e64eec61 service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received unexpected event network-vif-unplugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de for instance with vm_state active and task_state rescuing.
Nov 15 13:09:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG nova.network.neutron [req-bb919929-b6f0-4779-a78a-4e19343e6b40 req-7e4fd24a-69d0-454e-a8dd-1fc45e1c5c4a service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Updated VIF entry in instance network info cache for port c111045e-8778-439e-ac12-ce8b5f2c58a3. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG nova.network.neutron [req-bb919929-b6f0-4779-a78a-4e19343e6b40 req-7e4fd24a-69d0-454e-a8dd-1fc45e1c5c4a service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Updating instance_info_cache with network_info: [{"id": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "address": "fa:16:3e:eb:fd:6f", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc111045e-87", "ovs_interfaceid": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:09:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bb919929-b6f0-4779-a78a-4e19343e6b40 req-7e4fd24a-69d0-454e-a8dd-1fc45e1c5c4a service nova] Releasing lock "refresh_cache-4eb83276-6ce5-44c1-bd80-95c9bcba1d52" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:36 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Instance destroyed successfully.
Nov 15 13:09:36 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Attempting rescue
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75813) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Instance directory exists: not creating {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 13:09:36 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Creating image(s)
Nov 15 13:09:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "/opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.objects.instance [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'trusted_certs' on Instance uuid eaff87f2-d74c-4e1b-b471-33bd1aeeed34 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue" returned: 0 in 0.067s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.objects.instance [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'migration_context' on Instance uuid eaff87f2-d74c-4e1b-b471-33bd1aeeed34 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.objects.base [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<eaff87f2-d74c-4e1b-b471-33bd1aeeed34> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Start _get_guest_xml network_info=[{"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "vif_mac": "fa:16:3e:72:7b:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4d13142f-f571-4806-9713-890c0afeb458', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.objects.instance [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'resources' on Instance uuid eaff87f2-d74c-4e1b-b471-33bd1aeeed34 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.objects.base [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<eaff87f2-d74c-4e1b-b471-33bd1aeeed34> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.objects.instance [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'numa_topology' on Instance uuid eaff87f2-d74c-4e1b-b471-33bd1aeeed34 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.objects.base [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<eaff87f2-d74c-4e1b-b471-33bd1aeeed34> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:09:36 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:09:36 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.objects.instance [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'vcpu_model' on Instance uuid eaff87f2-d74c-4e1b-b471-33bd1aeeed34 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.objects.base [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<eaff87f2-d74c-4e1b-b471-33bd1aeeed34> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556918182',display_name='tempest-ServerRescueNegativeTestJSON-server-1556918182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556918182',id=35,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-jo61jy29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:07:54Z,user_data=None,user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=eaff87f2-d74c-4e1b-b471-33bd1aeeed34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "vif_mac": "fa:16:3e:72:7b:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "vif_mac": "fa:16:3e:72:7b:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=7f83e206-bb7e-4d53-a7fa-00c36bf649de,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f83e206-bb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.objects.instance [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'pci_devices' on Instance uuid eaff87f2-d74c-4e1b-b471-33bd1aeeed34 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.objects.base [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<eaff87f2-d74c-4e1b-b471-33bd1aeeed34> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:09:36 user nova-compute[75813]:   <uuid>eaff87f2-d74c-4e1b-b471-33bd1aeeed34</uuid>
Nov 15 13:09:36 user nova-compute[75813]:   <name>instance-00000023</name>
Nov 15 13:09:36 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:09:36 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:09:36 user nova-compute[75813]:   <metadata>
Nov 15 13:09:36 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:09:36 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:09:36 user nova-compute[75813]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1556918182</nova:name>
Nov 15 13:09:36 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:09:36</nova:creationTime>
Nov 15 13:09:36 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:09:36 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:09:36 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:09:36 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:09:36 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:09:36 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:09:36 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:09:36 user nova-compute[75813]:       <nova:owner>
Nov 15 13:09:36 user nova-compute[75813]:         <nova:user uuid="754cbdd42e894349bdacf3a0c7ba06cc">tempest-ServerRescueNegativeTestJSON-1475327670-project-member</nova:user>
Nov 15 13:09:36 user nova-compute[75813]:         <nova:project uuid="71da470a3bdb4093bc2b5db0b66fa08e">tempest-ServerRescueNegativeTestJSON-1475327670</nova:project>
Nov 15 13:09:36 user nova-compute[75813]:       </nova:owner>
Nov 15 13:09:36 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:09:36 user nova-compute[75813]:       <nova:ports>
Nov 15 13:09:36 user nova-compute[75813]:         <nova:port uuid="7f83e206-bb7e-4d53-a7fa-00c36bf649de">
Nov 15 13:09:36 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 13:09:36 user nova-compute[75813]:         </nova:port>
Nov 15 13:09:36 user nova-compute[75813]:       </nova:ports>
Nov 15 13:09:36 user nova-compute[75813]:     </nova:instance>
Nov 15 13:09:36 user nova-compute[75813]:   </metadata>
Nov 15 13:09:36 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:09:36 user nova-compute[75813]:     <system>
Nov 15 13:09:36 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:09:36 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:09:36 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:09:36 user nova-compute[75813]:       <entry name="serial">eaff87f2-d74c-4e1b-b471-33bd1aeeed34</entry>
Nov 15 13:09:36 user nova-compute[75813]:       <entry name="uuid">eaff87f2-d74c-4e1b-b471-33bd1aeeed34</entry>
Nov 15 13:09:36 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:09:36 user nova-compute[75813]:     </system>
Nov 15 13:09:36 user nova-compute[75813]:   </sysinfo>
Nov 15 13:09:36 user nova-compute[75813]:   <os>
Nov 15 13:09:36 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:09:36 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:09:36 user nova-compute[75813]:   </os>
Nov 15 13:09:36 user nova-compute[75813]:   <features>
Nov 15 13:09:36 user nova-compute[75813]:     <acpi/>
Nov 15 13:09:36 user nova-compute[75813]:     <apic/>
Nov 15 13:09:36 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:09:36 user nova-compute[75813]:   </features>
Nov 15 13:09:36 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:09:36 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:09:36 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:09:36 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:09:36 user nova-compute[75813]:   </clock>
Nov 15 13:09:36 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:09:36 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:09:36 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:09:36 user nova-compute[75813]:   </cpu>
Nov 15 13:09:36 user nova-compute[75813]:   <devices>
Nov 15 13:09:36 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:09:36 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:09:36 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue"/>
Nov 15 13:09:36 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:09:36 user nova-compute[75813]:     </disk>
Nov 15 13:09:36 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:09:36 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:09:36 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk"/>
Nov 15 13:09:36 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 13:09:36 user nova-compute[75813]:     </disk>
Nov 15 13:09:36 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:09:36 user nova-compute[75813]:       <mac address="fa:16:3e:72:7b:99"/>
Nov 15 13:09:36 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:09:36 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:09:36 user nova-compute[75813]:       <target dev="tap7f83e206-bb"/>
Nov 15 13:09:36 user nova-compute[75813]:     </interface>
Nov 15 13:09:36 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:09:36 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/console.log" append="off"/>
Nov 15 13:09:36 user nova-compute[75813]:     </serial>
Nov 15 13:09:36 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:09:36 user nova-compute[75813]:     <video>
Nov 15 13:09:36 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:09:36 user nova-compute[75813]:     </video>
Nov 15 13:09:36 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:09:36 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:09:36 user nova-compute[75813]:     </rng>
Nov 15 13:09:36 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:09:36 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:09:36 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:09:36 user nova-compute[75813]:     </memballoon>
Nov 15 13:09:36 user nova-compute[75813]:   </devices>
Nov 15 13:09:36 user nova-compute[75813]: </domain>
Nov 15 13:09:36 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:09:36 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Instance destroyed successfully.
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:09:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No VIF found with MAC fa:16:3e:72:7b:99, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:09:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-95e0631e-9744-4991-9860-6ba69d89e244 req-7a80dcdf-d374-4fd8-9a7e-e1def76bac8a service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:09:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-95e0631e-9744-4991-9860-6ba69d89e244 req-7a80dcdf-d374-4fd8-9a7e-e1def76bac8a service nova] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-95e0631e-9744-4991-9860-6ba69d89e244 req-7a80dcdf-d374-4fd8-9a7e-e1def76bac8a service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-95e0631e-9744-4991-9860-6ba69d89e244 req-7a80dcdf-d374-4fd8-9a7e-e1def76bac8a service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-95e0631e-9744-4991-9860-6ba69d89e244 req-7a80dcdf-d374-4fd8-9a7e-e1def76bac8a service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] No waiting events found dispatching network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:09:37 user nova-compute[75813]: WARNING nova.compute.manager [req-95e0631e-9744-4991-9860-6ba69d89e244 req-7a80dcdf-d374-4fd8-9a7e-e1def76bac8a service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received unexpected event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de for instance with vm_state active and task_state rescuing.
Nov 15 13:09:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG nova.objects.instance [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:38 user nova-compute[75813]: INFO nova.compute.manager [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Attaching volume 60a1e32b-dea9-47d6-a627-d84be914d96f to /dev/vdb
Nov 15 13:09:38 user nova-compute[75813]: DEBUG os_brick.utils [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[abde404c-77ac-45a8-b535-879626dbb2f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b622bb0c-73a7-46e5-919a-00d5e498100c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a6e783-3442-478d-b489-230520489aaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6583d94-18f2-46c8-a894-8d52ec842122]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:09:38 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:09:38 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f56308-05f6-4fa0-82be-eb98e65e6b93]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG os_brick.utils [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:09:38 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Updating existing volume attachment record: f85e7497-7461-4e07-8456-9549070a7288 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:09:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:09:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] No waiting events found dispatching network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:09:39 user nova-compute[75813]: WARNING nova.compute.manager [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received unexpected event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de for instance with vm_state active and task_state rescuing.
Nov 15 13:09:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:09:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] No waiting events found dispatching network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:09:39 user nova-compute[75813]: WARNING nova.compute.manager [req-601d23bc-f615-40c1-af74-0414da33e4fb req-9717777a-b071-4a20-ae9c-e830c564a23b service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received unexpected event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de for instance with vm_state active and task_state rescuing.
Nov 15 13:09:40 user nova-compute[75813]: DEBUG nova.compute.manager [None req-abe4f63f-de63-4d72-97a7-3f4be9c3c644 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:09:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZrxNEFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:09:43 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:09:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:09:43 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:09:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:09:43 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2be1167-20e8-4e30-b7dc-cf942d405a7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:09:43 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[18392c3c-3f5b-43cf-b05a-a3989b83a410]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f] added
Nov 15 13:09:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5ed5c5-9afa-41f5-b698-8cae613e735e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1f49f5-ef65-43e7-903a-8029913e4ab0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZrxNEFa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZrxNEFa" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bff020c-1174-44ba-ab79-bf6c7686c149]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tZrxNEFa'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[089fdba3-ad76-425c-85d6-06ce70fa9c0e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb9fea0-3b28-49be-af41-41ea3bf71e9c]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:09:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:09:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[46351b99-dcdb-46cf-b8d5-0d33d27fa8db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f, portal: 172.16.0.220,3260]
Nov 15 13:09:44 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f, portal: 172.16.0.220,3260] successful.
Nov 15 13:09:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9470fb59-f437-4464-b99b-9a0fe254738e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad55bdd7-f0c8-4be3-8459-3770dd166066]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)
Nov 15 13:09:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:09:44 user nova-compute[75813]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)
Nov 15 13:09:44 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] HCTL ('38', '-', '-', 0) found on session 45 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[107fed2a-738d-496c-97bd-613628ca3162]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching for a device in session 45 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:09:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZrxNEFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:09:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:09:45 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23461666238393865', 'path': '/dev/sdg'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:09:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461666238393865', 'path': '/dev/sdg'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:09:45 user nova-compute[75813]: DEBUG nova.objects.instance [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:09:45 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:09:45 user nova-compute[75813]:   <source dev="/dev/sdg"/>
Nov 15 13:09:45 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:09:45 user nova-compute[75813]:   <serial>60a1e32b-dea9-47d6-a627-d84be914d96f</serial>
Nov 15 13:09:45 user nova-compute[75813]: </disk>
Nov 15 13:09:45 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:09:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:09:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:09:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No VIF found with MAC fa:16:3e:eb:fd:6f, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:09:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-98fb9b7d-aa83-4006-b313-f63461792f82 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.463s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:48 user nova-compute[75813]: DEBUG nova.objects.instance [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:48 user nova-compute[75813]: INFO nova.compute.manager [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Attaching volume d38c50b3-e8bb-419b-ab48-26f6e4dca09e to /dev/vdc
Nov 15 13:09:49 user nova-compute[75813]: DEBUG os_brick.utils [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d668cf-626e-49a5-9880-a51cd393b017]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b90b89-a43c-4704-8f9e-88bf1ab8cd62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d013fe3c-eb32-49d2-a35b-0e99094c8cd1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b0bea-1a3e-4f87-ac3e-3c2b5e60b3df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:09:49 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:09:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[769331fe-5dad-4bc9-a0a7-b25f961b4531]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG os_brick.utils [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:09:49 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Updating existing volume attachment record: e354ab9e-de11-44fd-9108-c0b9cb7456d7 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:09:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:09:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:09:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:09:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:09:53 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:09:53 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updating instance_info_cache with network_info: [{"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:09:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:09:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:09:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTXJvdRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:09:54 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:09:54 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:09:54 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51705f8-3f73-4888-9fb3-d5eccdaab667]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:09:54 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1139548f-83fe-4bae-b401-c892bd6917c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e] added
Nov 15 13:09:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5d325a-9784-4337-9b6d-1bc96f33b6bb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52ccdcf-92b2-4266-8166-573b04b34165]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTXJvdRr {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTXJvdRr" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ae814e-0496-4493-a91d-49ba7f9b22cb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTXJvdRr'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fb2e4f-e362-42f8-9b27-50896c5a286d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[55134d06-c983-497a-8bde-28eed66e347d]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)
Nov 15 13:09:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)
Nov 15 13:09:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --login" returned: 0 in 0.177s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab3a006-335b-469d-8bd4-d1868c1d835c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e, portal: 172.16.0.220,3260]
Nov 15 13:09:54 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e, portal: 172.16.0.220,3260] successful.
Nov 15 13:09:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9739c8-57a1-401a-8b39-e86911b688a6]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[116092e9-0c27-4c77-b9f0-2a0efb92f500]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)
Nov 15 13:09:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)
Nov 15 13:09:54 user nova-compute[75813]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)
Nov 15 13:09:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] HCTL ('39', '-', '-', 0) found on session 46 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee62c861-358b-4cb3-850e-024aceff2b7c]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Searching for a device in session 46 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:09:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTXJvdRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:09:55 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:09:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:09:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:09:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23461636333353638', 'path': '/dev/sdh'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:09:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461636333353638', 'path': '/dev/sdh'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:09:55 user nova-compute[75813]: DEBUG nova.objects.instance [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:09:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:09:55 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:09:55 user nova-compute[75813]:   <source dev="/dev/sdh"/>
Nov 15 13:09:55 user nova-compute[75813]:   <target dev="vdc" bus="virtio"/>
Nov 15 13:09:55 user nova-compute[75813]:   <serial>d38c50b3-e8bb-419b-ab48-26f6e4dca09e</serial>
Nov 15 13:09:55 user nova-compute[75813]: </disk>
Nov 15 13:09:55 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:09:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:09:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:09:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:09:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] No VIF found with MAC fa:16:3e:eb:fd:6f, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:09:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aec54646-49cb-47ce-8779-62d48b0d87e8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.046s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:56 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:09:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:57 user nova-compute[75813]: INFO nova.compute.manager [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Detaching volume 60a1e32b-dea9-47d6-a627-d84be914d96f
Nov 15 13:09:57 user nova-compute[75813]: INFO nova.virt.block_device [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Attempting to driver detach volume 60a1e32b-dea9-47d6-a627-d84be914d96f from mountpoint /dev/vdb
Nov 15 13:09:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Attempting to detach device vdb from instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:09:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:09:57 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:09:57 user nova-compute[75813]:   <source dev="/dev/sdg"/>
Nov 15 13:09:57 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:09:57 user nova-compute[75813]:   <serial>60a1e32b-dea9-47d6-a627-d84be914d96f</serial>
Nov 15 13:09:57 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:09:57 user nova-compute[75813]: </disk>
Nov 15 13:09:57 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:09:57 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully detached device vdb from instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 from the persistent domain config.
Nov 15 13:09:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:09:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:09:57 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:09:57 user nova-compute[75813]:   <source dev="/dev/sdg"/>
Nov 15 13:09:57 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:09:57 user nova-compute[75813]:   <serial>60a1e32b-dea9-47d6-a627-d84be914d96f</serial>
Nov 15 13:09:57 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:09:57 user nova-compute[75813]: </disk>
Nov 15 13:09:57 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:09:57 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:09:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:09:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:09:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:10:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:10:02 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:10:02 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7482MB free_disk=24.90416717529297GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca153542-ced0-4884-827f-7af9517b6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance b74022f2-55af-4eb7-81e0-4696fefd5ae5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 1c2e968d-90ed-43b5-b54a-157fbe05b745 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 25669d63-7812-4e4c-a4ed-0e30f7515510 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 83a338e2-b102-404b-9cbf-730a62aa7e53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:10:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:03 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:10:03 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:10:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:10:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:10:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:10:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:10:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:16 user nova-compute[75813]: INFO nova.compute.manager [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Terminating instance
Nov 15 13:10:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:10:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ee28eb2-5ee0-4e57-9de0-c58a231ee200 req-1c27c824-b2fb-4251-946e-e586d41c0ca6 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-unplugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ee28eb2-5ee0-4e57-9de0-c58a231ee200 req-1c27c824-b2fb-4251-946e-e586d41c0ca6 service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ee28eb2-5ee0-4e57-9de0-c58a231ee200 req-1c27c824-b2fb-4251-946e-e586d41c0ca6 service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8ee28eb2-5ee0-4e57-9de0-c58a231ee200 req-1c27c824-b2fb-4251-946e-e586d41c0ca6 service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ee28eb2-5ee0-4e57-9de0-c58a231ee200 req-1c27c824-b2fb-4251-946e-e586d41c0ca6 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-unplugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-8ee28eb2-5ee0-4e57-9de0-c58a231ee200 req-1c27c824-b2fb-4251-946e-e586d41c0ca6 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-unplugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Instance destroyed successfully.
Nov 15 13:10:17 user nova-compute[75813]: DEBUG nova.objects.instance [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lazy-loading 'resources' on Instance uuid b74022f2-55af-4eb7-81e0-4696fefd5ae5 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T13:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-781384000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-781384000',id=30,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkUDCIMVpwJ2r5TfPwzRES7t2GVPpTHPcXaXt0ic3Rfm82sQfAAbf7CBQlEcYuXdL5tZfjX3t098yw/VS91DddIz1diZsymHOmYVBXCjVDBeI8TxiFp73nljQa0QLd50g==',key_name='tempest-keypair-1610888735',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:08:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eaef11927a74bd4a8dfa8f6a11ab367',ramdisk_id='',reservation_id='r-5d7gag7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1167418523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1167418523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:08:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f3642a668cd4e998ffbaf8f76f5d895',uuid=b74022f2-55af-4eb7-81e0-4696fefd5ae5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converting VIF {"id": "76c7059b-cb68-4832-940f-9832e339c26c", "address": "fa:16:3e:b6:23:56", "network": {"id": "dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-823052746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaef11927a74bd4a8dfa8f6a11ab367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c7059b-cb", "ovs_interfaceid": "76c7059b-cb68-4832-940f-9832e339c26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_vif [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76c7059b-cb, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a72d1188-4b62-4ac1-9751-253c2cb6c97e) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: INFO os_vif [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:56,bridge_name='br-int',has_traffic_filtering=True,id=76c7059b-cb68-4832-940f-9832e339c26c,network=Network(dd3f65b6-f28d-4f4d-aaa5-b3b0c4f23310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c7059b-cb')
Nov 15 13:10:17 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Deleting instance files /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5_del
Nov 15 13:10:17 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Deletion of /opt/stack/data/nova/instances/b74022f2-55af-4eb7-81e0-4696fefd5ae5_del complete
Nov 15 13:10:17 user nova-compute[75813]: INFO nova.compute.manager [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:10:17 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 is timed out.
Nov 15 13:10:17 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully detached device vdb from instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 from the live domain config.
Nov 15 13:10:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZrxNEFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:10:17 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed6384-2d44-4038-9739-7accbe6eb891]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:10:17 user nova-compute[75813]: No targets found.
Nov 15 13:10:17 user nova-compute[75813]: iSNS:
Nov 15 13:10:17 user nova-compute[75813]: No targets found.
Nov 15 13:10:17 user nova-compute[75813]: STATIC:
Nov 15 13:10:17 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e
Nov 15 13:10:17 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:17 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:17 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303
Nov 15 13:10:17 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:17 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:17 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89
Nov 15 13:10:17 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:17 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:17 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:10:17 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:17 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:17 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de
Nov 15 13:10:17 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:17 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:17 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f
Nov 15 13:10:17 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:17 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:17 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7
Nov 15 13:10:17 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:17 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:17 user nova-compute[75813]: FIRMWARE:
Nov 15 13:10:17 user nova-compute[75813]: No targets found.
Nov 15 13:10:17 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:10:17 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:10:17 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9c82c6-39ee-41bb-b22b-d873a253b548]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79f2fc6-3320-4cad-a114-e9e2efdad735]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)
Nov 15 13:10:17 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f (non-flash)
Nov 15 13:10:17 user nova-compute[75813]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)
Nov 15 13:10:17 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55548df760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f'): ({'sdg'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Removing single pathed devices sdg {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[511281b8-95f5-42c9-a75c-3e1b87f7c569]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d0d368-dd6d-426c-9e9f-59c9d6781896]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flushing IO for device /dev/sdg {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d05d26a-b72c-4243-b302-7d9d344bae59]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaaa911-12ca-4e4a-a7de-bccb669cd0c9]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] SCSI volumes sdg have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1dc01b-34f4-49ba-b876-f383d278d439]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b028c88-fa19-48c3-9cfc-5f51517fa1b0]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f, portal: 172.16.0.220,3260]
Nov 15 13:10:17 user nova-compute[75813]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f, portal: 172.16.0.220,3260] successful.
Nov 15 13:10:17 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60a1e32b-dea9-47d6-a627-d84be914d96f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7db8ecb-6bbd-42e4-8c19-0f7078265fe3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] <== disconnect_volume: return (391ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:10:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:10:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:18 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:10:18 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Took 0.89 seconds to deallocate network for instance.
Nov 15 13:10:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-d98d7b7f-7b2b-4156-a28c-7666d66d09a4 req-61b8201b-992d-4bb2-9a11-6a156c1de3d8 service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-deleted-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:18 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:10:18 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:10:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:10:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:18 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Deleted allocations for instance b74022f2-55af-4eb7-81e0-4696fefd5ae5
Nov 15 13:10:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-54222540-28e1-44f2-ba34-490f47ed4f9d tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.782s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-91c4fe55-9358-4305-9ef4-454ce980f24e tempest-AttachVolumeShelveTestJSON-1167418523 tempest-AttachVolumeShelveTestJSON-1167418523-project-member] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.161s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:19 user nova-compute[75813]: WARNING nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received unexpected event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with vm_state deleted and task_state None.
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:19 user nova-compute[75813]: WARNING nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received unexpected event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with vm_state deleted and task_state None.
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:19 user nova-compute[75813]: WARNING nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received unexpected event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with vm_state deleted and task_state None.
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-unplugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-unplugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:19 user nova-compute[75813]: WARNING nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received unexpected event network-vif-unplugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with vm_state deleted and task_state None.
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Acquiring lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] Lock "b74022f2-55af-4eb7-81e0-4696fefd5ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] No waiting events found dispatching network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:19 user nova-compute[75813]: WARNING nova.compute.manager [req-cf84e857-17c8-408a-8556-2eaaf2b0d0f4 req-50272c36-92f8-4740-8006-3e7ee962338f service nova] [instance: b74022f2-55af-4eb7-81e0-4696fefd5ae5] Received unexpected event network-vif-plugged-76c7059b-cb68-4832-940f-9832e339c26c for instance with vm_state deleted and task_state None.
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:19 user nova-compute[75813]: INFO nova.compute.manager [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Detaching volume d38c50b3-e8bb-419b-ab48-26f6e4dca09e
Nov 15 13:10:19 user nova-compute[75813]: INFO nova.virt.block_device [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Attempting to driver detach volume d38c50b3-e8bb-419b-ab48-26f6e4dca09e from mountpoint /dev/vdc
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Attempting to detach device vdc from instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:10:19 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:10:19 user nova-compute[75813]:   <source dev="/dev/sdh"/>
Nov 15 13:10:19 user nova-compute[75813]:   <target dev="vdc" bus="virtio"/>
Nov 15 13:10:19 user nova-compute[75813]:   <serial>d38c50b3-e8bb-419b-ab48-26f6e4dca09e</serial>
Nov 15 13:10:19 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 13:10:19 user nova-compute[75813]: </disk>
Nov 15 13:10:19 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:10:19 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully detached device vdc from instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 from the persistent domain config.
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:10:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:10:19 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:10:19 user nova-compute[75813]:   <source dev="/dev/sdh"/>
Nov 15 13:10:19 user nova-compute[75813]:   <target dev="vdc" bus="virtio"/>
Nov 15 13:10:19 user nova-compute[75813]:   <serial>d38c50b3-e8bb-419b-ab48-26f6e4dca09e</serial>
Nov 15 13:10:19 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 13:10:19 user nova-compute[75813]: </disk>
Nov 15 13:10:19 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:10:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:10:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-871e12e8-485c-427a-aa5c-e2e7a603ee72 req-e9d26f81-64cd-4c86-a4e9-e1f51564a118 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Received event network-changed-ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-871e12e8-485c-427a-aa5c-e2e7a603ee72 req-e9d26f81-64cd-4c86-a4e9-e1f51564a118 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Refreshing instance network info cache due to event network-changed-ac31f66f-d357-4a73-86ab-095fc363ffdd. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:10:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-871e12e8-485c-427a-aa5c-e2e7a603ee72 req-e9d26f81-64cd-4c86-a4e9-e1f51564a118 service nova] Acquiring lock "refresh_cache-1c2e968d-90ed-43b5-b54a-157fbe05b745" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:10:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-871e12e8-485c-427a-aa5c-e2e7a603ee72 req-e9d26f81-64cd-4c86-a4e9-e1f51564a118 service nova] Acquired lock "refresh_cache-1c2e968d-90ed-43b5-b54a-157fbe05b745" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:10:26 user nova-compute[75813]: DEBUG nova.network.neutron [req-871e12e8-485c-427a-aa5c-e2e7a603ee72 req-e9d26f81-64cd-4c86-a4e9-e1f51564a118 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Refreshing network info cache for port ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:10:26 user nova-compute[75813]: DEBUG nova.network.neutron [req-871e12e8-485c-427a-aa5c-e2e7a603ee72 req-e9d26f81-64cd-4c86-a4e9-e1f51564a118 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Updated VIF entry in instance network info cache for port ac31f66f-d357-4a73-86ab-095fc363ffdd. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:10:26 user nova-compute[75813]: DEBUG nova.network.neutron [req-871e12e8-485c-427a-aa5c-e2e7a603ee72 req-e9d26f81-64cd-4c86-a4e9-e1f51564a118 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Updating instance_info_cache with network_info: [{"id": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "address": "fa:16:3e:1f:5d:5f", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac31f66f-d3", "ovs_interfaceid": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-871e12e8-485c-427a-aa5c-e2e7a603ee72 req-e9d26f81-64cd-4c86-a4e9-e1f51564a118 service nova] Releasing lock "refresh_cache-1c2e968d-90ed-43b5-b54a-157fbe05b745" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "1c2e968d-90ed-43b5-b54a-157fbe05b745" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:27 user nova-compute[75813]: INFO nova.compute.manager [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Terminating instance
Nov 15 13:10:27 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-a81b603d-0109-48b4-b03a-e7d1715a4282 req-77eeaebc-56f1-4672-b268-392cd4e57f7c service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Received event network-vif-unplugged-ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a81b603d-0109-48b4-b03a-e7d1715a4282 req-77eeaebc-56f1-4672-b268-392cd4e57f7c service nova] Acquiring lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a81b603d-0109-48b4-b03a-e7d1715a4282 req-77eeaebc-56f1-4672-b268-392cd4e57f7c service nova] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a81b603d-0109-48b4-b03a-e7d1715a4282 req-77eeaebc-56f1-4672-b268-392cd4e57f7c service nova] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-a81b603d-0109-48b4-b03a-e7d1715a4282 req-77eeaebc-56f1-4672-b268-392cd4e57f7c service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] No waiting events found dispatching network-vif-unplugged-ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-a81b603d-0109-48b4-b03a-e7d1715a4282 req-77eeaebc-56f1-4672-b268-392cd4e57f7c service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Received event network-vif-unplugged-ac31f66f-d357-4a73-86ab-095fc363ffdd for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:27 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Instance destroyed successfully.
Nov 15 13:10:27 user nova-compute[75813]: DEBUG nova.objects.instance [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'resources' on Instance uuid 1c2e968d-90ed-43b5-b54a-157fbe05b745 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-410593620',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-410593620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-410593620',id=36,image_ref='49d73345-c951-48c8-a8df-cef693d2d38c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp3FgHh9MzoDIfFhfFTZnG1VtrDbMT6lVPVqzRUlDt47BKC1f2ZIKeitmgUbqzPy267DmE9qvqCbQWxmDx5HxaApaVrxtYUA6O07RBf8fZLiHx3E8StldJSb9pmkvbeaQ==',key_name='tempest-keypair-998247238',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:08:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-329szqtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-678819035',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=1c2e968d-90ed-43b5-b54a-157fbe05b745,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "address": "fa:16:3e:1f:5d:5f", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac31f66f-d3", "ovs_interfaceid": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "address": "fa:16:3e:1f:5d:5f", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac31f66f-d3", "ovs_interfaceid": "ac31f66f-d357-4a73-86ab-095fc363ffdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:5d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ac31f66f-d357-4a73-86ab-095fc363ffdd,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac31f66f-d3') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG os_vif [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:5d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ac31f66f-d357-4a73-86ab-095fc363ffdd,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac31f66f-d3') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac31f66f-d3, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b3646bf-1a24-40c4-9caf-cd881fb4a988) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:27 user nova-compute[75813]: INFO os_vif [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:5d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ac31f66f-d357-4a73-86ab-095fc363ffdd,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac31f66f-d3')
Nov 15 13:10:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nULDiMhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:10:27 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:10:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:10:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d4be01-ab45-458e-a36a-5d419e578ec2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:10:28 user nova-compute[75813]: No targets found.
Nov 15 13:10:28 user nova-compute[75813]: iSNS:
Nov 15 13:10:28 user nova-compute[75813]: No targets found.
Nov 15 13:10:28 user nova-compute[75813]: STATIC:
Nov 15 13:10:28 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e
Nov 15 13:10:28 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:28 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:28 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303
Nov 15 13:10:28 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:28 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:28 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89
Nov 15 13:10:28 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:28 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:28 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:10:28 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:28 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:28 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de
Nov 15 13:10:28 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:28 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:28 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7
Nov 15 13:10:28 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:28 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:28 user nova-compute[75813]: FIRMWARE:
Nov 15 13:10:28 user nova-compute[75813]: No targets found.
Nov 15 13:10:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:10:28 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:10:28 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b577e2e-cb18-4dcb-8762-a4016075a9f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e049c8-34f2-4041-90f2-0f8e184e6786]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:10:28 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:10:28 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:10:28 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:10:28 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:10:28 user nova-compute[75813]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)
Nov 15 13:10:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:10:28 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:10:28 user nova-compute[75813]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 (non-flash)
Nov 15 13:10:28 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:10:28 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:10:28 user nova-compute[75813]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)
Nov 15 13:10:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f553078a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303'): ({'sdd'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Removing single pathed devices sdd {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6904de0-d395-42d6-9f86-64346062834a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed25ebb8-461b-4f37-bcbb-1e30d7c83afa]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flushing IO for device /dev/sdd {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[42546dfa-f47a-402a-9d85-0cc3e4ac1be8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2414fa0-3dbf-4d18-8eb5-4a85de4b9de7]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_32061bf', '/dev/disk/by-id/scsi-26437383363356331', '/dev/disk/by-id/scsi-1SCST_BIO32061bf-d783c5c1233c1144') {{(pid=87167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 13:10:28 user nova-compute[75813]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_32061bf
Nov 15 13:10:28 user nova-compute[75813]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26437383363356331
Nov 15 13:10:28 user nova-compute[75813]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO32061bf-d783c5c1233c1144
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23f5a1b-6187-473f-b6a4-011bbcd8c48b]: (4, None) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf8c83-7f07-4710-a4d7-d69b4fcc0d98]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d67018a-c094-4324-a3fe-192ebeb3cc33]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303, portal: 172.16.0.220,3260]
Nov 15 13:10:28 user nova-compute[75813]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303, portal: 172.16.0.220,3260] successful.
Nov 15 13:10:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc94d5a-f771-4011-aa6d-7607de1a7303 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a2193f-c3dc-4e6c-97a3-9683585b989c]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== disconnect_volume: return (394ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:10:28 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Deleting instance files /opt/stack/data/nova/instances/1c2e968d-90ed-43b5-b54a-157fbe05b745_del
Nov 15 13:10:28 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Deletion of /opt/stack/data/nova/instances/1c2e968d-90ed-43b5-b54a-157fbe05b745_del complete
Nov 15 13:10:28 user nova-compute[75813]: INFO nova.compute.manager [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 15 13:10:28 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:10:28 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:10:29 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:10:29 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Took 0.67 seconds to deallocate network for instance.
Nov 15 13:10:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-ef34eb48-97c6-4a5a-8901-0c3038b82b77 req-daaad123-6fe9-4519-9065-e9a4f81c8e0a service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Received event network-vif-deleted-ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:29 user nova-compute[75813]: INFO nova.compute.manager [req-ef34eb48-97c6-4a5a-8901-0c3038b82b77 req-daaad123-6fe9-4519-9065-e9a4f81c8e0a service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Neutron deleted interface ac31f66f-d357-4a73-86ab-095fc363ffdd; detaching it from the instance and deleting it from the info cache
Nov 15 13:10:29 user nova-compute[75813]: DEBUG nova.network.neutron [req-ef34eb48-97c6-4a5a-8901-0c3038b82b77 req-daaad123-6fe9-4519-9065-e9a4f81c8e0a service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:10:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-ef34eb48-97c6-4a5a-8901-0c3038b82b77 req-daaad123-6fe9-4519-9065-e9a4f81c8e0a service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Detach interface failed, port_id=ac31f66f-d357-4a73-86ab-095fc363ffdd, reason: Instance 1c2e968d-90ed-43b5-b54a-157fbe05b745 could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 13:10:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-c9d6b03f-212d-44f5-9456-b56ea0e298cd req-5b167399-c844-45eb-9d81-7146fc140e77 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Received event network-vif-plugged-ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c9d6b03f-212d-44f5-9456-b56ea0e298cd req-5b167399-c844-45eb-9d81-7146fc140e77 service nova] Acquiring lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c9d6b03f-212d-44f5-9456-b56ea0e298cd req-5b167399-c844-45eb-9d81-7146fc140e77 service nova] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c9d6b03f-212d-44f5-9456-b56ea0e298cd req-5b167399-c844-45eb-9d81-7146fc140e77 service nova] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-c9d6b03f-212d-44f5-9456-b56ea0e298cd req-5b167399-c844-45eb-9d81-7146fc140e77 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] No waiting events found dispatching network-vif-plugged-ac31f66f-d357-4a73-86ab-095fc363ffdd {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:29 user nova-compute[75813]: WARNING nova.compute.manager [req-c9d6b03f-212d-44f5-9456-b56ea0e298cd req-5b167399-c844-45eb-9d81-7146fc140e77 service nova] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Received unexpected event network-vif-plugged-ac31f66f-d357-4a73-86ab-095fc363ffdd for instance with vm_state active and task_state deleting.
Nov 15 13:10:29 user nova-compute[75813]: INFO nova.compute.manager [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 13:10:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 1c2e968d-90ed-43b5-b54a-157fbe05b745] Deleting volume: 5fc94d5a-f771-4011-aa6d-7607de1a7303 {{(pid=75813) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 13:10:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:30 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:10:30 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:10:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:30 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Deleted allocations for instance 1c2e968d-90ed-43b5-b54a-157fbe05b745
Nov 15 13:10:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-aa0c0095-02a6-4cb5-8d74-5d4d0e588d70 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "1c2e968d-90ed-43b5-b54a-157fbe05b745" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.366s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:10:40 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 is timed out.
Nov 15 13:10:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully detached device vdc from instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 from the live domain config.
Nov 15 13:10:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTXJvdRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:10:40 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12ed5f5-530e-4c64-b12d-06fe309bc57f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:10:40 user nova-compute[75813]: No targets found.
Nov 15 13:10:40 user nova-compute[75813]: iSNS:
Nov 15 13:10:40 user nova-compute[75813]: No targets found.
Nov 15 13:10:40 user nova-compute[75813]: STATIC:
Nov 15 13:10:40 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e
Nov 15 13:10:40 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:40 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:40 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89
Nov 15 13:10:40 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:40 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:40 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:10:40 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:40 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:40 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de
Nov 15 13:10:40 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:40 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:40 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7
Nov 15 13:10:40 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:10:40 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:10:40 user nova-compute[75813]: FIRMWARE:
Nov 15 13:10:40 user nova-compute[75813]: No targets found.
Nov 15 13:10:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:10:40 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:10:40 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28c28a0-da0b-4e26-ae86-d177306323fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee25494-6eae-4ea0-8886-0ad5c54aa266]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:10:40 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:10:40 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:10:40 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:10:40 user nova-compute[75813]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)
Nov 15 13:10:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:10:40 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:10:40 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:10:40 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:10:40 user nova-compute[75813]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e (non-flash)
Nov 15 13:10:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555042d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e'): ({'sdh'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Removing single pathed devices sdh {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[78158932-a4e5-4509-9577-e8bc7d8cf4de]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a69f918-45a5-49f8-b12c-7f4157a1004a]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Flushing IO for device /dev/sdh {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1737a2-0932-48c5-8dc5-afd7489db76a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d5f301-bcb8-4fea-9719-e40cd2bd1c22]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] SCSI volumes sdh have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[975665cf-2c58-41b5-af6a-a00e52ae59e5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceecc11-6b2a-4644-9ebf-82b7642be791]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e, portal: 172.16.0.220,3260]
Nov 15 13:10:40 user nova-compute[75813]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e, portal: 172.16.0.220,3260] successful.
Nov 15 13:10:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d38c50b3-e8bb-419b-ab48-26f6e4dca09e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[379ba9ea-3fcb-47bd-842a-d4263dbdeee7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] <== disconnect_volume: return (344ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:10:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:10:41 user nova-compute[75813]: DEBUG nova.objects.instance [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'flavor' on Instance uuid 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:10:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b058058d-7d74-416a-857a-cc8f031b55c8 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.640s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:42 user nova-compute[75813]: INFO nova.compute.manager [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Terminating instance
Nov 15 13:10:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-84e589bc-4630-4fea-a698-0a276e8dc25a req-9da6a413-378d-4ad8-b927-da87ef42603e service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Received event network-vif-unplugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-84e589bc-4630-4fea-a698-0a276e8dc25a req-9da6a413-378d-4ad8-b927-da87ef42603e service nova] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-84e589bc-4630-4fea-a698-0a276e8dc25a req-9da6a413-378d-4ad8-b927-da87ef42603e service nova] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-84e589bc-4630-4fea-a698-0a276e8dc25a req-9da6a413-378d-4ad8-b927-da87ef42603e service nova] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-84e589bc-4630-4fea-a698-0a276e8dc25a req-9da6a413-378d-4ad8-b927-da87ef42603e service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] No waiting events found dispatching network-vif-unplugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-84e589bc-4630-4fea-a698-0a276e8dc25a req-9da6a413-378d-4ad8-b927-da87ef42603e service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Received event network-vif-unplugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:10:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:43 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Instance destroyed successfully.
Nov 15 13:10:43 user nova-compute[75813]: DEBUG nova.objects.instance [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lazy-loading 'resources' on Instance uuid 4eb83276-6ce5-44c1-bd80-95c9bcba1d52 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-46578006',display_name='tempest-AttachVolumeTestJSON-server-46578006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-46578006',id=34,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1+eECWI4qsBCB+9D0JdGKKZ+ESHsaK3DU4OyLplQs5WRKr8qqLYDqL06liSq36erBgI4fq6DC/BTKndyPzy5zJgcncKxGaGihNnwQqHwDQR2N1xmmUYjQ6ZumPzXnijg==',key_name='tempest-keypair-1128975402',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc78719b197c4db7bc6a13e3a57f3cb2',ramdisk_id='',reservation_id='r-s6n5xmf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-45300677',owner_user_name='tempest-AttachVolumeTestJSON-45300677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:07:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68d31c0d9bc4a66b3d81a892dee65ef',uuid=4eb83276-6ce5-44c1-bd80-95c9bcba1d52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "address": "fa:16:3e:eb:fd:6f", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc111045e-87", "ovs_interfaceid": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converting VIF {"id": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "address": "fa:16:3e:eb:fd:6f", "network": {"id": "dd9e6344-881f-4c17-9b12-e7862d06e267", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-273153955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc78719b197c4db7bc6a13e3a57f3cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc111045e-87", "ovs_interfaceid": "c111045e-8778-439e-ac12-ce8b5f2c58a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:fd:6f,bridge_name='br-int',has_traffic_filtering=True,id=c111045e-8778-439e-ac12-ce8b5f2c58a3,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc111045e-87') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG os_vif [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:fd:6f,bridge_name='br-int',has_traffic_filtering=True,id=c111045e-8778-439e-ac12-ce8b5f2c58a3,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc111045e-87') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc111045e-87, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc659087-6532-43bc-b890-c4cc3304be33) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:43 user nova-compute[75813]: INFO os_vif [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:fd:6f,bridge_name='br-int',has_traffic_filtering=True,id=c111045e-8778-439e-ac12-ce8b5f2c58a3,network=Network(dd9e6344-881f-4c17-9b12-e7862d06e267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc111045e-87')
Nov 15 13:10:43 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Deleting instance files /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52_del
Nov 15 13:10:43 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Deletion of /opt/stack/data/nova/instances/4eb83276-6ce5-44c1-bd80-95c9bcba1d52_del complete
Nov 15 13:10:43 user nova-compute[75813]: INFO nova.compute.manager [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 13:10:43 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:10:43 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:10:44 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:10:44 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Took 1.02 seconds to deallocate network for instance.
Nov 15 13:10:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:44 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:10:44 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:10:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:44 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Deleted allocations for instance 4eb83276-6ce5-44c1-bd80-95c9bcba1d52
Nov 15 13:10:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-7c3c2188-db77-4851-b792-303893a113a9 req-d090a63c-d1fe-4a0a-8468-7e85b144e8cb service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Received event network-vif-plugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7c3c2188-db77-4851-b792-303893a113a9 req-d090a63c-d1fe-4a0a-8468-7e85b144e8cb service nova] Acquiring lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7c3c2188-db77-4851-b792-303893a113a9 req-d090a63c-d1fe-4a0a-8468-7e85b144e8cb service nova] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7c3c2188-db77-4851-b792-303893a113a9 req-d090a63c-d1fe-4a0a-8468-7e85b144e8cb service nova] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-7c3c2188-db77-4851-b792-303893a113a9 req-d090a63c-d1fe-4a0a-8468-7e85b144e8cb service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] No waiting events found dispatching network-vif-plugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:44 user nova-compute[75813]: WARNING nova.compute.manager [req-7c3c2188-db77-4851-b792-303893a113a9 req-d090a63c-d1fe-4a0a-8468-7e85b144e8cb service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Received unexpected event network-vif-plugged-c111045e-8778-439e-ac12-ce8b5f2c58a3 for instance with vm_state deleted and task_state None.
Nov 15 13:10:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-7c3c2188-db77-4851-b792-303893a113a9 req-d090a63c-d1fe-4a0a-8468-7e85b144e8cb service nova] [instance: 4eb83276-6ce5-44c1-bd80-95c9bcba1d52] Received event network-vif-deleted-c111045e-8778-439e-ac12-ce8b5f2c58a3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-06a8f408-465d-4a8c-bc0d-94bd1c068076 tempest-AttachVolumeTestJSON-45300677 tempest-AttachVolumeTestJSON-45300677-project-member] Lock "4eb83276-6ce5-44c1-bd80-95c9bcba1d52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.401s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:50 user nova-compute[75813]: INFO nova.compute.manager [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Rescuing
Nov 15 13:10:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:10:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquired lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:10:50 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:10:51 user nova-compute[75813]: DEBUG nova.network.neutron [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Updating instance_info_cache with network_info: [{"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:10:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Releasing lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:10:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-6173bb6c-395f-42ac-85e3-88dd26544d8b req-0d9c4444-589b-4721-ac47-bd63b844fc6e service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-unplugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6173bb6c-395f-42ac-85e3-88dd26544d8b req-0d9c4444-589b-4721-ac47-bd63b844fc6e service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6173bb6c-395f-42ac-85e3-88dd26544d8b req-0d9c4444-589b-4721-ac47-bd63b844fc6e service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6173bb6c-395f-42ac-85e3-88dd26544d8b req-0d9c4444-589b-4721-ac47-bd63b844fc6e service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-6173bb6c-395f-42ac-85e3-88dd26544d8b req-0d9c4444-589b-4721-ac47-bd63b844fc6e service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-unplugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:51 user nova-compute[75813]: WARNING nova.compute.manager [req-6173bb6c-395f-42ac-85e3-88dd26544d8b req-0d9c4444-589b-4721-ac47-bd63b844fc6e service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received unexpected event network-vif-unplugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with vm_state active and task_state rescuing.
Nov 15 13:10:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Instance destroyed successfully.
Nov 15 13:10:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Attempting a stable device rescue
Nov 15 13:10:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75813) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 13:10:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Instance directory exists: not creating {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 13:10:52 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Creating image(s)
Nov 15 13:10:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "/opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "/opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "/opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:52 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25669d63-7812-4e4c-a4ed-0e30f7515510 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:10:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "aaedbf48f419030c097f9888d0889248c7e7f39d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "aaedbf48f419030c097f9888d0889248c7e7f39d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d.part --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG nova.virt.images [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] 67f8cfb3-6872-4a6e-a24a-48a1b5e32b36 was qcow2, converting to raw {{(pid=75813) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d.part /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d.converted {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG nova.compute.manager [req-8f93e070-4472-4f40-96d9-cb4513f0ef34 req-93794e0c-c9b2-4ec5-9ce3-57320e51b6c2 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8f93e070-4472-4f40-96d9-cb4513f0ef34 req-93794e0c-c9b2-4ec5-9ce3-57320e51b6c2 service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8f93e070-4472-4f40-96d9-cb4513f0ef34 req-93794e0c-c9b2-4ec5-9ce3-57320e51b6c2 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8f93e070-4472-4f40-96d9-cb4513f0ef34 req-93794e0c-c9b2-4ec5-9ce3-57320e51b6c2 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG nova.compute.manager [req-8f93e070-4472-4f40-96d9-cb4513f0ef34 req-93794e0c-c9b2-4ec5-9ce3-57320e51b6c2 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:53 user nova-compute[75813]: WARNING nova.compute.manager [req-8f93e070-4472-4f40-96d9-cb4513f0ef34 req-93794e0c-c9b2-4ec5-9ce3-57320e51b6c2 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received unexpected event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with vm_state active and task_state rescuing.
Nov 15 13:10:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d.part /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d.converted" returned: 0 in 0.460s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d.converted --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "aaedbf48f419030c097f9888d0889248c7e7f39d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.966s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "aaedbf48f419030c097f9888d0889248c7e7f39d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "aaedbf48f419030c097f9888d0889248c7e7f39d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d,backing_fmt=raw /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.rescue {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d,backing_fmt=raw /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.rescue" returned: 0 in 0.054s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "aaedbf48f419030c097f9888d0889248c7e7f39d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'migration_context' on Instance uuid 25669d63-7812-4e4c-a4ed-0e30f7515510 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.objects.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Object Instance<25669d63-7812-4e4c-a4ed-0e30f7515510> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Start _get_guest_xml network_info=[{"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "vif_mac": "fa:16:3e:c1:6c:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '67f8cfb3-6872-4a6e-a24a-48a1b5e32b36', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'df714670-d9e3-4420-a411-49b2ea7d591c', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVrKRgcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '25669d63-7812-4e4c-a4ed-0e30f7515510', 'attached_at': '', 'detached_at': '', 'volume_id': '6ba5cb91-40de-4cee-8dde-89cf61962f89', 'serial': '6ba5cb91-40de-4cee-8dde-89cf61962f89'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'resources' on Instance uuid 25669d63-7812-4e4c-a4ed-0e30f7515510 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.objects.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Object Instance<25669d63-7812-4e4c-a4ed-0e30f7515510> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'numa_topology' on Instance uuid 25669d63-7812-4e4c-a4ed-0e30f7515510 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.objects.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Object Instance<25669d63-7812-4e4c-a4ed-0e30f7515510> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:10:54 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:10:54 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25669d63-7812-4e4c-a4ed-0e30f7515510 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.objects.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Object Instance<25669d63-7812-4e4c-a4ed-0e30f7515510> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVrKRgcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:10:54 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:10:54 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:10:54 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7035cfa6-988e-414d-b39b-b661bfbd63ed]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HVrKRgcQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 13:10:54 user nova-compute[75813]: node.name = iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89
Nov 15 13:10:54 user nova-compute[75813]: node.tpgt = -1
Nov 15 13:10:54 user nova-compute[75813]: node.startup = automatic
Nov 15 13:10:54 user nova-compute[75813]: node.leading_login = No
Nov 15 13:10:54 user nova-compute[75813]: iface.iscsi_ifacename = default
Nov 15 13:10:54 user nova-compute[75813]: iface.net_ifacename = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.ipaddress = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.prefix_len = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.hwaddress = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.transport_name = tcp
Nov 15 13:10:54 user nova-compute[75813]: iface.initiatorname = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.state = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.vlan_id = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.vlan_priority = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.vlan_state = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.iface_num = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.mtu = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.port = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.bootproto = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.subnet_mask = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.gateway = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.dhcp_alt_client_id = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.dhcp_dns = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.dhcp_learn_iqn = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.dhcp_vendor_id_state = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.dhcp_vendor_id = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.dhcp_slp_da = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.fragmentation = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.gratuitous_arp = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.incoming_forwarding = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.tos_state = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.tos = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.ttl = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.delayed_ack = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.tcp_nagle = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.tcp_wsf_state = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.tcp_wsf = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.tcp_timer_scale = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.tcp_timestamp = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.redirect = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.def_task_mgmt_timeout = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.header_digest = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.data_digest = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.immediate_data = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.initial_r2t = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.data_seq_inorder = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.data_pdu_inorder = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.erl = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.max_receive_data_len = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.first_burst_len = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.max_outstanding_r2t = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.max_burst_len = 0
Nov 15 13:10:54 user nova-compute[75813]: iface.chap_auth = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.bidi_chap = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.strict_login_compliance = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.discovery_auth = <empty>
Nov 15 13:10:54 user nova-compute[75813]: iface.discovery_logout = <empty>
Nov 15 13:10:54 user nova-compute[75813]: node.discovery_address = <empty>
Nov 15 13:10:54 user nova-compute[75813]: node.discovery_port = 0
Nov 15 13:10:54 user nova-compute[75813]: node.discovery_type = static
Nov 15 13:10:54 user nova-compute[75813]: node.session.initial_cmdsn = 0
Nov 15 13:10:54 user nova-compute[75813]: node.session.initial_login_retry_max = 8
Nov 15 13:10:54 user nova-compute[75813]: node.session.xmit_thread_priority = -20
Nov 15 13:10:54 user nova-compute[75813]: node.session.cmds_max = 128
Nov 15 13:10:54 user nova-compute[75813]: node.session.queue_depth = 32
Nov 15 13:10:54 user nova-compute[75813]: node.session.nr_sessions = 1
Nov 15 13:10:54 user nova-compute[75813]: node.session.auth.authmethod = CHAP
Nov 15 13:10:54 user nova-compute[75813]: node.session.auth.username = HVrKRgcQ
Nov 15 13:10:54 user nova-compute[75813]: node.session.auth.password = ***
Nov 15 13:10:54 user nova-compute[75813]: node.session.auth.username_in = <empty>
Nov 15 13:10:54 user nova-compute[75813]: node.session.auth.password_in = <empty>
Nov 15 13:10:54 user nova-compute[75813]: node.session.auth.chap_algs = MD5
Nov 15 13:10:54 user nova-compute[75813]: node.session.timeo.replacement_timeout = 120
Nov 15 13:10:54 user nova-compute[75813]: node.session.err_timeo.abort_timeout = 15
Nov 15 13:10:54 user nova-compute[75813]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 13:10:54 user nova-compute[75813]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 13:10:54 user nova-compute[75813]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 13:10:54 user nova-compute[75813]: node.session.iscsi.FastAbort = Yes
Nov 15 13:10:54 user nova-compute[75813]: node.session.iscsi.InitialR2T = No
Nov 15 13:10:54 user nova-compute[75813]: node.session.iscsi.ImmediateData = Yes
Nov 15 13:10:54 user nova-compute[75813]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 13:10:54 user nova-compute[75813]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 13:10:54 user nova-compute[75813]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 13:10:54 user nova-compute[75813]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 13:10:54 user nova-compute[75813]: node.session.iscsi.MaxConnections = 1
Nov 15 13:10:54 user nova-compute[75813]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 13:10:54 user nova-compute[75813]: node.session.iscsi.ERL = 0
Nov 15 13:10:54 user nova-compute[75813]: node.session.scan = manual
Nov 15 13:10:54 user nova-compute[75813]: node.session.reopen_max = 0
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].address = 172.16.0.220
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].port = 3260
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].startup = manual
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].tcp.window_size = 524288
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].tcp.type_of_service = 0
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].timeo.logout_timeout = 15
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].timeo.login_timeout = 15
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].timeo.auth_timeout = 45
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].iscsi.DataDigest = None
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].iscsi.IFMarker = No
Nov 15 13:10:54 user nova-compute[75813]: node.conn[0].iscsi.OFMarker = No
Nov 15 13:10:54 user nova-compute[75813]: # END RECORD
Nov 15 13:10:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d749d86c-9308-41a0-a39d-a67509144221]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5204fdfd-3927-4bc0-8d53-ef10b255d1fc]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVrKRgcQ {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVrKRgcQ" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c80917-ba99-46d8-b8e9-b5dd00b76181]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HVrKRgcQ'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5e687f-3ec3-4f4c-83d4-bfd392dd71e1]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9819a4-847c-471f-9295-308f81c80dcd]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:10:54 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:10:54 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:10:54 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:10:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:10:54 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:10:54 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:10:54 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:10:54 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.137s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] HCTL ('36', '0', '0', 0) found on session 43 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc51f18-816e-438c-b6b1-fe4b6e3f1667]: (4, ('0 0 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Searching for a device in session 43 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVrKRgcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.162s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] <== connect_volume: return (164ms) {'type': 'block', 'scsi_wwn': '26561306635613234', 'path': '/dev/sde'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561306635613234', 'path': '/dev/sde'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2032798804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2032798804',id=37,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:09:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-bby005p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:09:17Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=25669d63-7812-4e4c-a4ed-0e30f7515510,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "vif_mac": "fa:16:3e:c1:6c:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "vif_mac": "fa:16:3e:c1:6c:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=5224c182-a272-4ff3-86b6-780e6f0f7593,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5224c182-a2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'pci_devices' on Instance uuid 25669d63-7812-4e4c-a4ed-0e30f7515510 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.objects.base [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Object Instance<25669d63-7812-4e4c-a4ed-0e30f7515510> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:10:54 user nova-compute[75813]:   <uuid>25669d63-7812-4e4c-a4ed-0e30f7515510</uuid>
Nov 15 13:10:54 user nova-compute[75813]:   <name>instance-00000025</name>
Nov 15 13:10:54 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:10:54 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:10:54 user nova-compute[75813]:   <metadata>
Nov 15 13:10:54 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:10:54 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:10:54 user nova-compute[75813]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2032798804</nova:name>
Nov 15 13:10:54 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:10:54</nova:creationTime>
Nov 15 13:10:54 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:10:54 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:10:54 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:10:54 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:10:54 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:10:54 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:10:54 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:10:54 user nova-compute[75813]:       <nova:owner>
Nov 15 13:10:54 user nova-compute[75813]:         <nova:user uuid="07f52b120c2e46e2a8ca7eb83dafceca">tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member</nova:user>
Nov 15 13:10:54 user nova-compute[75813]:         <nova:project uuid="134cc574095942efb38b85068bc72bfe">tempest-ServerBootFromVolumeStableRescueTest-2006280819</nova:project>
Nov 15 13:10:54 user nova-compute[75813]:       </nova:owner>
Nov 15 13:10:54 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:10:54 user nova-compute[75813]:       <nova:ports>
Nov 15 13:10:54 user nova-compute[75813]:         <nova:port uuid="5224c182-a272-4ff3-86b6-780e6f0f7593">
Nov 15 13:10:54 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 13:10:54 user nova-compute[75813]:         </nova:port>
Nov 15 13:10:54 user nova-compute[75813]:       </nova:ports>
Nov 15 13:10:54 user nova-compute[75813]:     </nova:instance>
Nov 15 13:10:54 user nova-compute[75813]:   </metadata>
Nov 15 13:10:54 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:10:54 user nova-compute[75813]:     <system>
Nov 15 13:10:54 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:10:54 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:10:54 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:10:54 user nova-compute[75813]:       <entry name="serial">25669d63-7812-4e4c-a4ed-0e30f7515510</entry>
Nov 15 13:10:54 user nova-compute[75813]:       <entry name="uuid">25669d63-7812-4e4c-a4ed-0e30f7515510</entry>
Nov 15 13:10:54 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:10:54 user nova-compute[75813]:     </system>
Nov 15 13:10:54 user nova-compute[75813]:   </sysinfo>
Nov 15 13:10:54 user nova-compute[75813]:   <os>
Nov 15 13:10:54 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:10:54 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:10:54 user nova-compute[75813]:   </os>
Nov 15 13:10:54 user nova-compute[75813]:   <features>
Nov 15 13:10:54 user nova-compute[75813]:     <acpi/>
Nov 15 13:10:54 user nova-compute[75813]:     <apic/>
Nov 15 13:10:54 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:10:54 user nova-compute[75813]:   </features>
Nov 15 13:10:54 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:10:54 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:10:54 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:10:54 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:10:54 user nova-compute[75813]:   </clock>
Nov 15 13:10:54 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:10:54 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:10:54 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:10:54 user nova-compute[75813]:   </cpu>
Nov 15 13:10:54 user nova-compute[75813]:   <devices>
Nov 15 13:10:54 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:10:54 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:10:54 user nova-compute[75813]:       <source dev="/dev/sde"/>
Nov 15 13:10:54 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:10:54 user nova-compute[75813]:       <serial>6ba5cb91-40de-4cee-8dde-89cf61962f89</serial>
Nov 15 13:10:54 user nova-compute[75813]:     </disk>
Nov 15 13:10:54 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:10:54 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:10:54 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.rescue"/>
Nov 15 13:10:54 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 13:10:54 user nova-compute[75813]:       <boot order="1"/>
Nov 15 13:10:54 user nova-compute[75813]:     </disk>
Nov 15 13:10:54 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:10:54 user nova-compute[75813]:       <mac address="fa:16:3e:c1:6c:5b"/>
Nov 15 13:10:54 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:10:54 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:10:54 user nova-compute[75813]:       <target dev="tap5224c182-a2"/>
Nov 15 13:10:54 user nova-compute[75813]:     </interface>
Nov 15 13:10:54 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:10:54 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/console.log" append="off"/>
Nov 15 13:10:54 user nova-compute[75813]:     </serial>
Nov 15 13:10:54 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:10:54 user nova-compute[75813]:     <video>
Nov 15 13:10:54 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:10:54 user nova-compute[75813]:     </video>
Nov 15 13:10:54 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:10:54 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:10:54 user nova-compute[75813]:     </rng>
Nov 15 13:10:54 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:10:54 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:10:54 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:10:54 user nova-compute[75813]:     </memballoon>
Nov 15 13:10:54 user nova-compute[75813]:   </devices>
Nov 15 13:10:54 user nova-compute[75813]: </domain>
Nov 15 13:10:54 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:10:54 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Instance destroyed successfully.
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:10:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] No VIF found with MAC fa:16:3e:c1:6c:5b, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-ca153542-ced0-4884-827f-7af9517b6d8a" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-ca153542-ced0-4884-827f-7af9517b6d8a" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Updating instance_info_cache with network_info: [{"id": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "address": "fa:16:3e:53:76:4d", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46e2aba-da", "ovs_interfaceid": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-ca153542-ced0-4884-827f-7af9517b6d8a" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:10:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-24815243-3880-4d3c-a023-982f2827e397 req-6ac0251f-b4bf-42ad-b8a6-3717ca4d8b4e service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-24815243-3880-4d3c-a023-982f2827e397 req-6ac0251f-b4bf-42ad-b8a6-3717ca4d8b4e service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-24815243-3880-4d3c-a023-982f2827e397 req-6ac0251f-b4bf-42ad-b8a6-3717ca4d8b4e service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-24815243-3880-4d3c-a023-982f2827e397 req-6ac0251f-b4bf-42ad-b8a6-3717ca4d8b4e service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-24815243-3880-4d3c-a023-982f2827e397 req-6ac0251f-b4bf-42ad-b8a6-3717ca4d8b4e service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:56 user nova-compute[75813]: WARNING nova.compute.manager [req-24815243-3880-4d3c-a023-982f2827e397 req-6ac0251f-b4bf-42ad-b8a6-3717ca4d8b4e service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received unexpected event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with vm_state active and task_state rescuing.
Nov 15 13:10:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:10:57 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:10:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-3ed3cc63-db89-49da-9250-3d8f1f326bd2 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:10:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:10:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-ec2c2ce1-2ca6-475b-ad8c-cbf9e6c85ff9 req-be7751f3-2d8a-4846-99b1-576f6bba7c13 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:10:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ec2c2ce1-2ca6-475b-ad8c-cbf9e6c85ff9 req-be7751f3-2d8a-4846-99b1-576f6bba7c13 service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:10:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ec2c2ce1-2ca6-475b-ad8c-cbf9e6c85ff9 req-be7751f3-2d8a-4846-99b1-576f6bba7c13 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:10:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ec2c2ce1-2ca6-475b-ad8c-cbf9e6c85ff9 req-be7751f3-2d8a-4846-99b1-576f6bba7c13 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:10:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-ec2c2ce1-2ca6-475b-ad8c-cbf9e6c85ff9 req-be7751f3-2d8a-4846-99b1-576f6bba7c13 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:10:58 user nova-compute[75813]: WARNING nova.compute.manager [req-ec2c2ce1-2ca6-475b-ad8c-cbf9e6c85ff9 req-be7751f3-2d8a-4846-99b1-576f6bba7c13 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received unexpected event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with vm_state rescued and task_state None.
Nov 15 13:10:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:01 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:11:03 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:11:03 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7982MB free_disk=24.84743881225586GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca153542-ced0-4884-827f-7af9517b6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 25669d63-7812-4e4c-a4ed-0e30f7515510 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 83a338e2-b102-404b-9cbf-730a62aa7e53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:11:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:11:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:11:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:11:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:11:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:11:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:11:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:11 user nova-compute[75813]: DEBUG nova.compute.manager [req-7778d41b-37e1-46cc-8292-f8ad01d06131 req-d271fc5b-31b7-46c3-9c51-bf77a9dea001 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received event network-changed-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:11:11 user nova-compute[75813]: DEBUG nova.compute.manager [req-7778d41b-37e1-46cc-8292-f8ad01d06131 req-d271fc5b-31b7-46c3-9c51-bf77a9dea001 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Refreshing instance network info cache due to event network-changed-47f90629-6062-435c-82c7-44fb6630327c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:11:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7778d41b-37e1-46cc-8292-f8ad01d06131 req-d271fc5b-31b7-46c3-9c51-bf77a9dea001 service nova] Acquiring lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:11:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7778d41b-37e1-46cc-8292-f8ad01d06131 req-d271fc5b-31b7-46c3-9c51-bf77a9dea001 service nova] Acquired lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:11:11 user nova-compute[75813]: DEBUG nova.network.neutron [req-7778d41b-37e1-46cc-8292-f8ad01d06131 req-d271fc5b-31b7-46c3-9c51-bf77a9dea001 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Refreshing network info cache for port 47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:11:11 user nova-compute[75813]: DEBUG nova.network.neutron [req-7778d41b-37e1-46cc-8292-f8ad01d06131 req-d271fc5b-31b7-46c3-9c51-bf77a9dea001 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updated VIF entry in instance network info cache for port 47f90629-6062-435c-82c7-44fb6630327c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:11:11 user nova-compute[75813]: DEBUG nova.network.neutron [req-7778d41b-37e1-46cc-8292-f8ad01d06131 req-d271fc5b-31b7-46c3-9c51-bf77a9dea001 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updating instance_info_cache with network_info: [{"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:11:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-7778d41b-37e1-46cc-8292-f8ad01d06131 req-d271fc5b-31b7-46c3-9c51-bf77a9dea001 service nova] Releasing lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Stashing vm_state: active {{(pid=75813) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:11:13 user nova-compute[75813]: INFO nova.compute.claims [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Claim successful on node user
Nov 15 13:11:13 user nova-compute[75813]: INFO nova.compute.resource_tracker [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updating resource usage from migration 84e6da68-9af6-4d46-98ea-7c60415113c9
Nov 15 13:11:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-e63d4015-c9b6-47f5-aaff-540308263137 req-8778ef58-6339-488e-8164-aec2e12d5bc9 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-changed-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-e63d4015-c9b6-47f5-aaff-540308263137 req-8778ef58-6339-488e-8164-aec2e12d5bc9 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Refreshing instance network info cache due to event network-changed-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e63d4015-c9b6-47f5-aaff-540308263137 req-8778ef58-6339-488e-8164-aec2e12d5bc9 service nova] Acquiring lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e63d4015-c9b6-47f5-aaff-540308263137 req-8778ef58-6339-488e-8164-aec2e12d5bc9 service nova] Acquired lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG nova.network.neutron [req-e63d4015-c9b6-47f5-aaff-540308263137 req-8778ef58-6339-488e-8164-aec2e12d5bc9 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Refreshing network info cache for port ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:11:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.427s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:13 user nova-compute[75813]: INFO nova.compute.manager [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Migrating
Nov 15 13:11:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG nova.network.neutron [req-e63d4015-c9b6-47f5-aaff-540308263137 req-8778ef58-6339-488e-8164-aec2e12d5bc9 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updated VIF entry in instance network info cache for port ccf18cc9-6aa6-4822-b7e4-e7f635a34e78. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG nova.network.neutron [req-e63d4015-c9b6-47f5-aaff-540308263137 req-8778ef58-6339-488e-8164-aec2e12d5bc9 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updating instance_info_cache with network_info: [{"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e63d4015-c9b6-47f5-aaff-540308263137 req-8778ef58-6339-488e-8164-aec2e12d5bc9 service nova] Releasing lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquired lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updating instance_info_cache with network_info: [{"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Releasing lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Starting migrate_disk_and_power_off {{(pid=75813) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-37213adc-c530-4438-bf16-02a02f07a866 req-a506bca5-68a4-429d-bcf0-83e6e48b5c35 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-vif-unplugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-37213adc-c530-4438-bf16-02a02f07a866 req-a506bca5-68a4-429d-bcf0-83e6e48b5c35 service nova] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-37213adc-c530-4438-bf16-02a02f07a866 req-a506bca5-68a4-429d-bcf0-83e6e48b5c35 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-37213adc-c530-4438-bf16-02a02f07a866 req-a506bca5-68a4-429d-bcf0-83e6e48b5c35 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-37213adc-c530-4438-bf16-02a02f07a866 req-a506bca5-68a4-429d-bcf0-83e6e48b5c35 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] No waiting events found dispatching network-vif-unplugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:11:14 user nova-compute[75813]: WARNING nova.compute.manager [req-37213adc-c530-4438-bf16-02a02f07a866 req-a506bca5-68a4-429d-bcf0-83e6e48b5c35 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received unexpected event network-vif-unplugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 for instance with vm_state active and task_state resize_migrating.
Nov 15 13:11:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Instance destroyed successfully.
Nov 15 13:11:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1229970695',display_name='tempest-ServerActionsTestOtherA-server-1229970695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1229970695',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVScCZLXI8rlN2zoy2tMpAv6grzq+Q7BUD3jx/c9Ws+QNGWvOGcy9SrrC2M21ruqsJkGVx6GSsSkIbkFK6Q0lAtOU+eEFXMzxHts/+TJKb69Xyco0mKWaJkDc6A3DpPzg==',key_name='tempest-keypair-21661059',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-g37n7g8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:11:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=83a338e2-b102-404b-9cbf-730a62aa7e53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1744536350-network", "vif_mac": "fa:16:3e:1a:ca:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1744536350-network", "vif_mac": "fa:16:3e:1a:ca:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_vif [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccf18cc9-6a, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23c88494-468e-46e4-84b2-572f6a66ec9d) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:11:15 user nova-compute[75813]: INFO os_vif [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a')
Nov 15 13:11:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiOkrRng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:11:15 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[187d8496-fd96-42f3-800d-2ca96c1c3d50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:11:15 user nova-compute[75813]: No targets found.
Nov 15 13:11:15 user nova-compute[75813]: iSNS:
Nov 15 13:11:15 user nova-compute[75813]: No targets found.
Nov 15 13:11:15 user nova-compute[75813]: STATIC:
Nov 15 13:11:15 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89
Nov 15 13:11:15 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:11:15 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:11:15 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:11:15 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:11:15 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:11:15 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de
Nov 15 13:11:15 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:11:15 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:11:15 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7
Nov 15 13:11:15 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:11:15 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:11:15 user nova-compute[75813]: FIRMWARE:
Nov 15 13:11:15 user nova-compute[75813]: No targets found.
Nov 15 13:11:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:11:15 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:11:15 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[793a7da8-3d6d-4b07-80d3-830b57289d7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e128c6-f80a-46f7-8ef1-656cf25880cd]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:11:15 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:11:15 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:11:15 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:11:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:11:15 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:11:15 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:11:15 user nova-compute[75813]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:11:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555014bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de'): ({'sdf'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Removing single pathed devices sdf {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced74221-7ff9-4103-8d67-4391137cdedf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef59efc4-9dd3-4b97-a51d-e86b5d524428]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flushing IO for device /dev/sdf {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b603cd-267f-43b1-9279-0762224b4c4f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8111d6ab-5970-4d84-9dc0-cde6e9094f07]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26232316639393030', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_688856e2', '/dev/disk/by-id/scsi-1SCST_BIO688856e2-b21f9900d5b85c0a') {{(pid=87167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 13:11:15 user nova-compute[75813]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26232316639393030
Nov 15 13:11:15 user nova-compute[75813]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_688856e2
Nov 15 13:11:15 user nova-compute[75813]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO688856e2-b21f9900d5b85c0a
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78786f6-df88-496f-b303-d81a78c336e6]: (4, None) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[01086f86-6744-48e5-828d-b953ad199969]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a8d051-464a-4df6-b5ba-e7061d752f81]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260]
Nov 15 13:11:15 user nova-compute[75813]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260] successful.
Nov 15 13:11:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.085s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acf3431-2b87-4c14-88de-26e740bbb340]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== disconnect_volume: return (398ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:11:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:11:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:16 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Port ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 binding to destination host user is already ACTIVE {{(pid=75813) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 13:11:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-e5c27c59-3477-4135-bcf2-e53eb48d5cf4 req-f1148478-35c9-4b36-9d0e-dd2b5043a162 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e5c27c59-3477-4135-bcf2-e53eb48d5cf4 req-f1148478-35c9-4b36-9d0e-dd2b5043a162 service nova] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e5c27c59-3477-4135-bcf2-e53eb48d5cf4 req-f1148478-35c9-4b36-9d0e-dd2b5043a162 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e5c27c59-3477-4135-bcf2-e53eb48d5cf4 req-f1148478-35c9-4b36-9d0e-dd2b5043a162 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-e5c27c59-3477-4135-bcf2-e53eb48d5cf4 req-f1148478-35c9-4b36-9d0e-dd2b5043a162 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] No waiting events found dispatching network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:11:17 user nova-compute[75813]: WARNING nova.compute.manager [req-e5c27c59-3477-4135-bcf2-e53eb48d5cf4 req-f1148478-35c9-4b36-9d0e-dd2b5043a162 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received unexpected event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 for instance with vm_state active and task_state resize_migrated.
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquired lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updating instance_info_cache with network_info: [{"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Releasing lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG os_brick.utils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[be929f6e-2a48-419c-93d5-facab73139fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81d8c70-4a0f-4aaa-b673-4e326f523579]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f01115-f80b-4e78-8c24-ce8b8a65d220]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09026b0-f2be-4a8a-a672-043da7566d95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:11:17 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:11:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabec83a-c683-4fb3-a797-0706840804e4]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:11:17 user nova-compute[75813]: DEBUG os_brick.utils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:19 user nova-compute[75813]: INFO nova.compute.manager [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Terminating instance
Nov 15 13:11:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-33974a05-d981-464e-aad3-f1a96b71703e req-dd13aa82-2249-414a-a321-211b6758ce37 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Received event network-vif-unplugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-33974a05-d981-464e-aad3-f1a96b71703e req-dd13aa82-2249-414a-a321-211b6758ce37 service nova] Acquiring lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-33974a05-d981-464e-aad3-f1a96b71703e req-dd13aa82-2249-414a-a321-211b6758ce37 service nova] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-33974a05-d981-464e-aad3-f1a96b71703e req-dd13aa82-2249-414a-a321-211b6758ce37 service nova] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-33974a05-d981-464e-aad3-f1a96b71703e req-dd13aa82-2249-414a-a321-211b6758ce37 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] No waiting events found dispatching network-vif-unplugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:11:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-33974a05-d981-464e-aad3-f1a96b71703e req-dd13aa82-2249-414a-a321-211b6758ce37 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Received event network-vif-unplugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Instance destroyed successfully.
Nov 15 13:11:20 user nova-compute[75813]: DEBUG nova.objects.instance [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'resources' on Instance uuid 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1890619950',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1890619950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1890619950',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCANFGsyGP+5VanSh73vYgMZ/zkoqlXTP6uW67dnVAvWotvt8kOLrmLFptTAoFniPH3wkiq9eIiOKkGuTSlXsp9jHrwJYJBzeAI9RgKW0UWwc4+3q92L9C9TGU0dt1kHfQ==',key_name='tempest-keypair-1298991320',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-pmqtsobf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=3a6627d2-9dee-4591-9020-bd0d7ba9b9d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "address": "fa:16:3e:49:23:51", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64a9689-ab", "ovs_interfaceid": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "address": "fa:16:3e:49:23:51", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc64a9689-ab", "ovs_interfaceid": "c64a9689-ab31-4330-8a2b-02bb3ed8aba3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:51,bridge_name='br-int',has_traffic_filtering=True,id=c64a9689-ab31-4330-8a2b-02bb3ed8aba3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64a9689-ab') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_vif [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:51,bridge_name='br-int',has_traffic_filtering=True,id=c64a9689-ab31-4330-8a2b-02bb3ed8aba3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64a9689-ab') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc64a9689-ab, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c22f9c4-1660-4299-964a-434a686df4e8) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:11:20 user nova-compute[75813]: INFO os_vif [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:51,bridge_name='br-int',has_traffic_filtering=True,id=c64a9689-ab31-4330-8a2b-02bb3ed8aba3,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc64a9689-ab')
Nov 15 13:11:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZuEOBDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:11:20 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a0d7c5-c5ff-452b-b638-34da1c8217d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:11:20 user nova-compute[75813]: No targets found.
Nov 15 13:11:20 user nova-compute[75813]: iSNS:
Nov 15 13:11:20 user nova-compute[75813]: No targets found.
Nov 15 13:11:20 user nova-compute[75813]: STATIC:
Nov 15 13:11:20 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89
Nov 15 13:11:20 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:11:20 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:11:20 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:11:20 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:11:20 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:11:20 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7
Nov 15 13:11:20 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:11:20 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:11:20 user nova-compute[75813]: FIRMWARE:
Nov 15 13:11:20 user nova-compute[75813]: No targets found.
Nov 15 13:11:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:11:20 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:11:20 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf82804-374b-486a-86fa-95fc482792ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade3e7e3-d685-4b1c-91c5-e32c9f4c762a]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:11:20 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:11:20 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:11:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:11:20 user nova-compute[75813]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 (non-flash)
Nov 15 13:11:20 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:11:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5530767010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29599c0-3954-490f-b148-378fa48507fe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2022602a-ee3a-4fc5-8f25-d1320bde38ec]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[94078287-d0d6-400d-befa-cf1c36ccc355]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[284d4716-6550-428f-903a-746082ece3cf]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23431373332373335', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8b72231b', '/dev/disk/by-id/scsi-1SCST_BIO8b72231b-41732735fa548f13') {{(pid=87167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1716b24d-19c4-4ea0-83c6-4af4cb92cc00]: (4, None) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43ed88b-e415-49a6-bfa1-1d84f5a11c47]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a731139-2877-4df1-b8cb-e62c903a1255]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7, portal: 172.16.0.220,3260]
Nov 15 13:11:20 user nova-compute[75813]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7, portal: 172.16.0.220,3260] successful.
Nov 15 13:11:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c34bea-a258-4fb0-8960-20f8cb6c15c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98bb72b-29d9-4761-9208-e4bba0c7eb44]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== disconnect_volume: return (337ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:11:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Deleting instance files /opt/stack/data/nova/instances/3a6627d2-9dee-4591-9020-bd0d7ba9b9d6_del
Nov 15 13:11:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Deletion of /opt/stack/data/nova/instances/3a6627d2-9dee-4591-9020-bd0d7ba9b9d6_del complete
Nov 15 13:11:20 user nova-compute[75813]: INFO nova.compute.manager [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 15 13:11:20 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:11:20 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:11:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:21 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:11:21 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Took 0.73 seconds to deallocate network for instance.
Nov 15 13:11:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-2317d2dd-598d-4629-9a0f-937936f5905b req-805d25be-69e8-4c9f-bd37-b13d87eda187 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Received event network-vif-deleted-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-93fffebf-3018-4fd8-b19e-c5c4f3acf1ed req-25d6407f-9a69-48de-89cb-a792c398c0a6 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Received event network-vif-plugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-93fffebf-3018-4fd8-b19e-c5c4f3acf1ed req-25d6407f-9a69-48de-89cb-a792c398c0a6 service nova] Acquiring lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-93fffebf-3018-4fd8-b19e-c5c4f3acf1ed req-25d6407f-9a69-48de-89cb-a792c398c0a6 service nova] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-93fffebf-3018-4fd8-b19e-c5c4f3acf1ed req-25d6407f-9a69-48de-89cb-a792c398c0a6 service nova] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-93fffebf-3018-4fd8-b19e-c5c4f3acf1ed req-25d6407f-9a69-48de-89cb-a792c398c0a6 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] No waiting events found dispatching network-vif-plugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:11:22 user nova-compute[75813]: WARNING nova.compute.manager [req-93fffebf-3018-4fd8-b19e-c5c4f3acf1ed req-25d6407f-9a69-48de-89cb-a792c398c0a6 service nova] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Received unexpected event network-vif-plugged-c64a9689-ab31-4330-8a2b-02bb3ed8aba3 for instance with vm_state active and task_state deleting.
Nov 15 13:11:22 user nova-compute[75813]: INFO nova.compute.manager [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Took 0.85 seconds to detach 1 volumes for instance.
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.compute.manager [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6] Deleting volume: d1c34bea-a258-4fb0-8960-20f8cb6c15c7 {{(pid=75813) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Starting finish_migration {{(pid=75813) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Instance directory exists: not creating {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 13:11:22 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Creating image(s)
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Ensure instance console log exists: /opt/stack/data/nova/instances/83a338e2-b102-404b-9cbf-730a62aa7e53/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Start _get_guest_xml network_info=[{"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1744536350-network", "vif_mac": "fa:16:3e:1a:ca:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '9158b75d-0265-4edf-8221-3db863be3722', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiOkrRng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '83a338e2-b102-404b-9cbf-730a62aa7e53', 'attached_at': '2023-11-15T13:11:23.000000', 'detached_at': '', 'volume_id': '33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 'serial': '33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:11:22 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:11:22 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiOkrRng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:11:22 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:11:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:11:22 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:11:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:11:22 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fddac3-d8e0-428d-b5ad-d38edff10c72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:11:22 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[16937b4e-7ede-4904-8428-10c47c73e54c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de] added
Nov 15 13:11:22 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fc6603-1046-461b-a41f-4520399dc802]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ed025e-b504-4487-9669-d80ee4dab002]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiOkrRng {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiOkrRng" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e8e4b0-5b2d-436d-8c2e-167d8263fb15]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UiOkrRng'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f62ac29-e3ba-41ef-8a34-6a49c02440c5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdd3c12-047b-450f-a164-6ce37e5ccdda]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:11:23 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:11:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:11:23 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:11:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d1d2e7-d1cd-4182-9ad8-fa08f0c3e5f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260]
Nov 15 13:11:23 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260] successful.
Nov 15 13:11:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:23 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Deleted allocations for instance 3a6627d2-9dee-4591-9020-bd0d7ba9b9d6
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb44cef-9adf-4019-a681-f2f2fd2d3bde]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[151219ce-15a4-48df-8623-b2997ed07c13]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:11:23 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:11:23 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:11:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:11:23 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:11:23 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:11:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c861e7b-653f-43e3-9094-4513a57ed68d]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:11:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ea5c036b-f61b-4994-8f5c-b922f2c061d3 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "3a6627d2-9dee-4591-9020-bd0d7ba9b9d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.626s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiOkrRng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26232316639393030', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232316639393030', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1229970695',display_name='tempest-ServerActionsTestOtherA-server-1229970695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1229970695',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVScCZLXI8rlN2zoy2tMpAv6grzq+Q7BUD3jx/c9Ws+QNGWvOGcy9SrrC2M21ruqsJkGVx6GSsSkIbkFK6Q0lAtOU+eEFXMzxHts/+TJKb69Xyco0mKWaJkDc6A3DpPzg==',key_name='tempest-keypair-21661059',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-g37n7g8z',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=83a338e2-b102-404b-9cbf-730a62aa7e53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1744536350-network", "vif_mac": "fa:16:3e:1a:ca:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1744536350-network", "vif_mac": "fa:16:3e:1a:ca:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:11:24 user nova-compute[75813]:   <uuid>83a338e2-b102-404b-9cbf-730a62aa7e53</uuid>
Nov 15 13:11:24 user nova-compute[75813]:   <name>instance-00000026</name>
Nov 15 13:11:24 user nova-compute[75813]:   <memory>2097152</memory>
Nov 15 13:11:24 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:11:24 user nova-compute[75813]:   <metadata>
Nov 15 13:11:24 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:11:24 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:11:24 user nova-compute[75813]:       <nova:name>tempest-ServerActionsTestOtherA-server-1229970695</nova:name>
Nov 15 13:11:24 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:11:22</nova:creationTime>
Nov 15 13:11:24 user nova-compute[75813]:       <nova:flavor name="m1.small">
Nov 15 13:11:24 user nova-compute[75813]:         <nova:memory>2048</nova:memory>
Nov 15 13:11:24 user nova-compute[75813]:         <nova:disk>20</nova:disk>
Nov 15 13:11:24 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:11:24 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:11:24 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:11:24 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:11:24 user nova-compute[75813]:       <nova:owner>
Nov 15 13:11:24 user nova-compute[75813]:         <nova:user uuid="c2b3f74a69954ecf8d5cce188f5fc043">tempest-ServerActionsTestOtherA-1826218173-project-member</nova:user>
Nov 15 13:11:24 user nova-compute[75813]:         <nova:project uuid="76ae639fa3444ba0be3d480b8572a0e6">tempest-ServerActionsTestOtherA-1826218173</nova:project>
Nov 15 13:11:24 user nova-compute[75813]:       </nova:owner>
Nov 15 13:11:24 user nova-compute[75813]:       <nova:ports>
Nov 15 13:11:24 user nova-compute[75813]:         <nova:port uuid="ccf18cc9-6aa6-4822-b7e4-e7f635a34e78">
Nov 15 13:11:24 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 13:11:24 user nova-compute[75813]:         </nova:port>
Nov 15 13:11:24 user nova-compute[75813]:       </nova:ports>
Nov 15 13:11:24 user nova-compute[75813]:     </nova:instance>
Nov 15 13:11:24 user nova-compute[75813]:   </metadata>
Nov 15 13:11:24 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:11:24 user nova-compute[75813]:     <system>
Nov 15 13:11:24 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:11:24 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:11:24 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:11:24 user nova-compute[75813]:       <entry name="serial">83a338e2-b102-404b-9cbf-730a62aa7e53</entry>
Nov 15 13:11:24 user nova-compute[75813]:       <entry name="uuid">83a338e2-b102-404b-9cbf-730a62aa7e53</entry>
Nov 15 13:11:24 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:11:24 user nova-compute[75813]:     </system>
Nov 15 13:11:24 user nova-compute[75813]:   </sysinfo>
Nov 15 13:11:24 user nova-compute[75813]:   <os>
Nov 15 13:11:24 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:11:24 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:11:24 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:11:24 user nova-compute[75813]:   </os>
Nov 15 13:11:24 user nova-compute[75813]:   <features>
Nov 15 13:11:24 user nova-compute[75813]:     <acpi/>
Nov 15 13:11:24 user nova-compute[75813]:     <apic/>
Nov 15 13:11:24 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:11:24 user nova-compute[75813]:   </features>
Nov 15 13:11:24 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:11:24 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:11:24 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:11:24 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:11:24 user nova-compute[75813]:   </clock>
Nov 15 13:11:24 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:11:24 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:11:24 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:11:24 user nova-compute[75813]:   </cpu>
Nov 15 13:11:24 user nova-compute[75813]:   <devices>
Nov 15 13:11:24 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:11:24 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:11:24 user nova-compute[75813]:       <source dev="/dev/sdb"/>
Nov 15 13:11:24 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:11:24 user nova-compute[75813]:       <serial>33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de</serial>
Nov 15 13:11:24 user nova-compute[75813]:     </disk>
Nov 15 13:11:24 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:11:24 user nova-compute[75813]:       <mac address="fa:16:3e:1a:ca:82"/>
Nov 15 13:11:24 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:11:24 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:11:24 user nova-compute[75813]:       <target dev="tapccf18cc9-6a"/>
Nov 15 13:11:24 user nova-compute[75813]:     </interface>
Nov 15 13:11:24 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:11:24 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/83a338e2-b102-404b-9cbf-730a62aa7e53/console.log" append="off"/>
Nov 15 13:11:24 user nova-compute[75813]:     </serial>
Nov 15 13:11:24 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:11:24 user nova-compute[75813]:     <video>
Nov 15 13:11:24 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:11:24 user nova-compute[75813]:     </video>
Nov 15 13:11:24 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:11:24 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:11:24 user nova-compute[75813]:     </rng>
Nov 15 13:11:24 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:11:24 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:11:24 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:11:24 user nova-compute[75813]:     </memballoon>
Nov 15 13:11:24 user nova-compute[75813]:   </devices>
Nov 15 13:11:24 user nova-compute[75813]: </domain>
Nov 15 13:11:24 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1229970695',display_name='tempest-ServerActionsTestOtherA-server-1229970695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1229970695',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVScCZLXI8rlN2zoy2tMpAv6grzq+Q7BUD3jx/c9Ws+QNGWvOGcy9SrrC2M21ruqsJkGVx6GSsSkIbkFK6Q0lAtOU+eEFXMzxHts/+TJKb69Xyco0mKWaJkDc6A3DpPzg==',key_name='tempest-keypair-21661059',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-g37n7g8z',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=83a338e2-b102-404b-9cbf-730a62aa7e53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1744536350-network", "vif_mac": "fa:16:3e:1a:ca:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1744536350-network", "vif_mac": "fa:16:3e:1a:ca:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG os_vif [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aee842aa-62a3-5b29-bf5a-74176f1e62cd', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccf18cc9-6a, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccf18cc9-6a, col_values=(('qos', UUID('f54124b1-893e-43bf-9b59-3c9d0d177c93')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccf18cc9-6a, col_values=(('external_ids', {'iface-id': 'ccf18cc9-6aa6-4822-b7e4-e7f635a34e78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:ca:82', 'vm-uuid': '83a338e2-b102-404b-9cbf-730a62aa7e53'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:24 user nova-compute[75813]: INFO os_vif [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a')
Nov 15 13:11:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:11:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] No VIF found with MAC fa:16:3e:1a:ca:82, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:11:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-023cbb53-f53d-49d7-878a-55cae59e69f7 req-6f1dd3e1-f527-4e51-a09b-0bbb5dbb6b57 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:11:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-023cbb53-f53d-49d7-878a-55cae59e69f7 req-6f1dd3e1-f527-4e51-a09b-0bbb5dbb6b57 service nova] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-023cbb53-f53d-49d7-878a-55cae59e69f7 req-6f1dd3e1-f527-4e51-a09b-0bbb5dbb6b57 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-023cbb53-f53d-49d7-878a-55cae59e69f7 req-6f1dd3e1-f527-4e51-a09b-0bbb5dbb6b57 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-023cbb53-f53d-49d7-878a-55cae59e69f7 req-6f1dd3e1-f527-4e51-a09b-0bbb5dbb6b57 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] No waiting events found dispatching network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:11:26 user nova-compute[75813]: WARNING nova.compute.manager [req-023cbb53-f53d-49d7-878a-55cae59e69f7 req-6f1dd3e1-f527-4e51-a09b-0bbb5dbb6b57 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received unexpected event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 for instance with vm_state active and task_state resize_finish.
Nov 15 13:11:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:28 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:11:28 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Instance running successfully.
Nov 15 13:11:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Failed to set time: agent not configured {{(pid=75813) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 13:11:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d28be0b3-3fe1-4a57-a169-b58265061e7c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] finish_migration finished successfully. {{(pid=75813) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 13:11:28 user nova-compute[75813]: DEBUG nova.compute.manager [req-52d6e926-7c80-4c04-801f-8646f1ba8a90 req-3517aa89-a056-40b6-85be-66eec9fe8c21 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:11:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-52d6e926-7c80-4c04-801f-8646f1ba8a90 req-3517aa89-a056-40b6-85be-66eec9fe8c21 service nova] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:11:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-52d6e926-7c80-4c04-801f-8646f1ba8a90 req-3517aa89-a056-40b6-85be-66eec9fe8c21 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:11:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-52d6e926-7c80-4c04-801f-8646f1ba8a90 req-3517aa89-a056-40b6-85be-66eec9fe8c21 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:11:28 user nova-compute[75813]: DEBUG nova.compute.manager [req-52d6e926-7c80-4c04-801f-8646f1ba8a90 req-3517aa89-a056-40b6-85be-66eec9fe8c21 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] No waiting events found dispatching network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:11:28 user nova-compute[75813]: WARNING nova.compute.manager [req-52d6e926-7c80-4c04-801f-8646f1ba8a90 req-3517aa89-a056-40b6-85be-66eec9fe8c21 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received unexpected event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 for instance with vm_state active and task_state resize_finish.
Nov 15 13:11:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:55 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:11:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:11:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 13:11:55 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:11:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:11:57 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:11:57 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:11:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:11:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:00 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:12:00 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:12:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:12:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:12:05 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:12:05 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8024MB free_disk=24.83269500732422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Applying migration context for instance 83a338e2-b102-404b-9cbf-730a62aa7e53 as it has an incoming, in-progress migration 84e6da68-9af6-4d46-98ea-7c60415113c9. Migration status is finished {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 13:12:05 user nova-compute[75813]: INFO nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updating resource usage from migration 84e6da68-9af6-4d46-98ea-7c60415113c9
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca153542-ced0-4884-827f-7af9517b6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 25669d63-7812-4e4c-a4ed-0e30f7515510 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Migration 84e6da68-9af6-4d46-98ea-7c60415113c9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 83a338e2-b102-404b-9cbf-730a62aa7e53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:12:05 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:12:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:12:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:12:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:12:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:12:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:12:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:12 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:12:12 user nova-compute[75813]: INFO nova.compute.claims [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Claim successful on node user
Nov 15 13:12:13 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG nova.network.neutron [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:12:13 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:12:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG nova.policy [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea5ceaf286514f268b169a27bbfd4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a3450c054f9490f65fa0a603e699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:12:13 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Creating image(s)
Nov 15 13:12:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "/opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "/opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "3d4655580f652f0f53323f34e45be3783eb5cdae" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "3d4655580f652f0f53323f34e45be3783eb5cdae" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae.part --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG nova.network.neutron [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Successfully created port: 1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG nova.virt.images [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4 was qcow2, converting to raw {{(pid=75813) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae.part /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae.converted {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae.part /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae.converted" returned: 0 in 0.371s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae.converted --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "3d4655580f652f0f53323f34e45be3783eb5cdae" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.217s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG nova.network.neutron [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Successfully updated port: 1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-449a580d-7a00-447f-90f9-de4962f69239 req-3fa6dbaf-8524-46ac-979e-08c0fa8fdd7d service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-changed-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-449a580d-7a00-447f-90f9-de4962f69239 req-3fa6dbaf-8524-46ac-979e-08c0fa8fdd7d service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Refreshing instance network info cache due to event network-changed-1f078b11-852d-42c3-93f7-9ccacc104851. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-449a580d-7a00-447f-90f9-de4962f69239 req-3fa6dbaf-8524-46ac-979e-08c0fa8fdd7d service nova] Acquiring lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-449a580d-7a00-447f-90f9-de4962f69239 req-3fa6dbaf-8524-46ac-979e-08c0fa8fdd7d service nova] Acquired lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG nova.network.neutron [req-449a580d-7a00-447f-90f9-de4962f69239 req-3fa6dbaf-8524-46ac-979e-08c0fa8fdd7d service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Refreshing network info cache for port 1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG nova.network.neutron [req-449a580d-7a00-447f-90f9-de4962f69239 req-3fa6dbaf-8524-46ac-979e-08c0fa8fdd7d service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "3d4655580f652f0f53323f34e45be3783eb5cdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "3d4655580f652f0f53323f34e45be3783eb5cdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.network.neutron [req-449a580d-7a00-447f-90f9-de4962f69239 req-3fa6dbaf-8524-46ac-979e-08c0fa8fdd7d service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-449a580d-7a00-447f-90f9-de4962f69239 req-3fa6dbaf-8524-46ac-979e-08c0fa8fdd7d service nova] Releasing lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquired lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae --force-share --output=json" returned: 0 in 0.208s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae,backing_fmt=raw /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae,backing_fmt=raw /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk 1073741824" returned: 0 in 0.059s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "3d4655580f652f0f53323f34e45be3783eb5cdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updating instance_info_cache with network_info: [{"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Releasing lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Instance network_info: |[{"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Cannot resize image /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Ensure instance console log exists: /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Start _get_guest_xml network_info=[{"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T13:12:10Z,direct_url=<?>,disk_format='qcow2',id=ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4,min_disk=0,min_ram=0,name='tempest-scenario-img--761997231',owner='5875a3450c054f9490f65fa0a603e699',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T13:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': 'ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:12:15 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:12:15 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T13:12:10Z,direct_url=<?>,disk_format='qcow2',id=ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4,min_disk=0,min_ram=0,name='tempest-scenario-img--761997231',owner='5875a3450c054f9490f65fa0a603e699',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T13:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2049584342',display_name='tempest-TestMinimumBasicScenario-server-2049584342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2049584342',id=39,image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa5tjbIEXhETwBangxK8fm82xWdlgvkGh0IwuZr+qf/5VH2hvHWFWMKycuaEXAFhAO+nW6Cesgaj6aMDOYdmbSgXWm4W3KyrShhiUTmG9ZUaj24Gkb/9DIRJ5FiFluMaA==',key_name='tempest-TestMinimumBasicScenario-1466995340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5875a3450c054f9490f65fa0a603e699',ramdisk_id='',reservation_id='r-f5yh83em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-651110609',owner_user_name='tempest-TestMinimumBasicScenario-651110609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:12:13Z,user_data=None,user_id='ea5ceaf286514f268b169a27bbfd4006',uuid=1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converting VIF {"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.objects.instance [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:12:15 user nova-compute[75813]:   <uuid>1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf</uuid>
Nov 15 13:12:15 user nova-compute[75813]:   <name>instance-00000027</name>
Nov 15 13:12:15 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:12:15 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:12:15 user nova-compute[75813]:   <metadata>
Nov 15 13:12:15 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:12:15 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:12:15 user nova-compute[75813]:       <nova:name>tempest-TestMinimumBasicScenario-server-2049584342</nova:name>
Nov 15 13:12:15 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:12:15</nova:creationTime>
Nov 15 13:12:15 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:12:15 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:12:15 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:12:15 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:12:15 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:12:15 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:12:15 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:12:15 user nova-compute[75813]:       <nova:owner>
Nov 15 13:12:15 user nova-compute[75813]:         <nova:user uuid="ea5ceaf286514f268b169a27bbfd4006">tempest-TestMinimumBasicScenario-651110609-project-member</nova:user>
Nov 15 13:12:15 user nova-compute[75813]:         <nova:project uuid="5875a3450c054f9490f65fa0a603e699">tempest-TestMinimumBasicScenario-651110609</nova:project>
Nov 15 13:12:15 user nova-compute[75813]:       </nova:owner>
Nov 15 13:12:15 user nova-compute[75813]:       <nova:root type="image" uuid="ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4"/>
Nov 15 13:12:15 user nova-compute[75813]:       <nova:ports>
Nov 15 13:12:15 user nova-compute[75813]:         <nova:port uuid="1f078b11-852d-42c3-93f7-9ccacc104851">
Nov 15 13:12:15 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 13:12:15 user nova-compute[75813]:         </nova:port>
Nov 15 13:12:15 user nova-compute[75813]:       </nova:ports>
Nov 15 13:12:15 user nova-compute[75813]:     </nova:instance>
Nov 15 13:12:15 user nova-compute[75813]:   </metadata>
Nov 15 13:12:15 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:12:15 user nova-compute[75813]:     <system>
Nov 15 13:12:15 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:12:15 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:12:15 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:12:15 user nova-compute[75813]:       <entry name="serial">1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf</entry>
Nov 15 13:12:15 user nova-compute[75813]:       <entry name="uuid">1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf</entry>
Nov 15 13:12:15 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:12:15 user nova-compute[75813]:     </system>
Nov 15 13:12:15 user nova-compute[75813]:   </sysinfo>
Nov 15 13:12:15 user nova-compute[75813]:   <os>
Nov 15 13:12:15 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:12:15 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:12:15 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:12:15 user nova-compute[75813]:   </os>
Nov 15 13:12:15 user nova-compute[75813]:   <features>
Nov 15 13:12:15 user nova-compute[75813]:     <acpi/>
Nov 15 13:12:15 user nova-compute[75813]:     <apic/>
Nov 15 13:12:15 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:12:15 user nova-compute[75813]:   </features>
Nov 15 13:12:15 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:12:15 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:12:15 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:12:15 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:12:15 user nova-compute[75813]:   </clock>
Nov 15 13:12:15 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:12:15 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:12:15 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:12:15 user nova-compute[75813]:   </cpu>
Nov 15 13:12:15 user nova-compute[75813]:   <devices>
Nov 15 13:12:15 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:12:15 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:12:15 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk"/>
Nov 15 13:12:15 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:12:15 user nova-compute[75813]:     </disk>
Nov 15 13:12:15 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:12:15 user nova-compute[75813]:       <mac address="fa:16:3e:c7:07:30"/>
Nov 15 13:12:15 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:12:15 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:12:15 user nova-compute[75813]:       <target dev="tap1f078b11-85"/>
Nov 15 13:12:15 user nova-compute[75813]:     </interface>
Nov 15 13:12:15 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:12:15 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/console.log" append="off"/>
Nov 15 13:12:15 user nova-compute[75813]:     </serial>
Nov 15 13:12:15 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:12:15 user nova-compute[75813]:     <video>
Nov 15 13:12:15 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:12:15 user nova-compute[75813]:     </video>
Nov 15 13:12:15 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:12:15 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:12:15 user nova-compute[75813]:     </rng>
Nov 15 13:12:15 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:12:15 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:12:15 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:12:15 user nova-compute[75813]:     </memballoon>
Nov 15 13:12:15 user nova-compute[75813]:   </devices>
Nov 15 13:12:15 user nova-compute[75813]: </domain>
Nov 15 13:12:15 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2049584342',display_name='tempest-TestMinimumBasicScenario-server-2049584342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2049584342',id=39,image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa5tjbIEXhETwBangxK8fm82xWdlgvkGh0IwuZr+qf/5VH2hvHWFWMKycuaEXAFhAO+nW6Cesgaj6aMDOYdmbSgXWm4W3KyrShhiUTmG9ZUaj24Gkb/9DIRJ5FiFluMaA==',key_name='tempest-TestMinimumBasicScenario-1466995340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5875a3450c054f9490f65fa0a603e699',ramdisk_id='',reservation_id='r-f5yh83em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-651110609',owner_user_name='tempest-TestMinimumBasicScenario-651110609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:12:13Z,user_data=None,user_id='ea5ceaf286514f268b169a27bbfd4006',uuid=1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converting VIF {"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG os_vif [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fff8346b-c201-5cab-8982-17342510e426', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f078b11-85, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f078b11-85, col_values=(('qos', UUID('db4c71af-1237-47ae-83e7-819cb8337933')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f078b11-85, col_values=(('external_ids', {'iface-id': '1f078b11-852d-42c3-93f7-9ccacc104851', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:07:30', 'vm-uuid': '1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:15 user nova-compute[75813]: INFO os_vif [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85')
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:12:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] No VIF found with MAC fa:16:3e:c7:07:30, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:12:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-44b1a646-b5ea-493c-ad05-dbf7ad87168f req-857a899f-60de-4fee-9ea5-f7230f2b7887 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-44b1a646-b5ea-493c-ad05-dbf7ad87168f req-857a899f-60de-4fee-9ea5-f7230f2b7887 service nova] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-44b1a646-b5ea-493c-ad05-dbf7ad87168f req-857a899f-60de-4fee-9ea5-f7230f2b7887 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-44b1a646-b5ea-493c-ad05-dbf7ad87168f req-857a899f-60de-4fee-9ea5-f7230f2b7887 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-44b1a646-b5ea-493c-ad05-dbf7ad87168f req-857a899f-60de-4fee-9ea5-f7230f2b7887 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] No waiting events found dispatching network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:17 user nova-compute[75813]: WARNING nova.compute.manager [req-44b1a646-b5ea-493c-ad05-dbf7ad87168f req-857a899f-60de-4fee-9ea5-f7230f2b7887 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received unexpected event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 for instance with vm_state building and task_state spawning.
Nov 15 13:12:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "6f6b89e1-6387-4cc0-9879-18005298fe74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:12:17 user nova-compute[75813]: INFO nova.compute.claims [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Claim successful on node user
Nov 15 13:12:18 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG nova.network.neutron [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:12:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:12:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG nova.policy [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bc41f21cddc40e7a287b6f809233a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63086918b1c84a608c4a5aebf968eab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:12:18 user nova-compute[75813]: INFO nova.virt.block_device [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Booting with volume 58122a0b-746d-4f27-8699-2e20361443c7 at /dev/vda
Nov 15 13:12:18 user nova-compute[75813]: DEBUG os_brick.utils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dabe9d-625f-418e-8c36-52a0f88a4f86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d6c7eb-07ec-4fae-ac43-9c6770687f52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cbb756-1f34-432e-8d8e-32252018f7e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec5d813-3618-4524-8666-77b68fccdc9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:12:18 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:12:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a95a31-2f09-45a7-8700-0f5051f4db58]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG os_brick.utils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:12:18 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Updating existing volume attachment record: d86e4476-f77b-4569-91f6-9429abe9d1ba {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.network.neutron [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Successfully created port: 53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-e9acc381-a143-444a-97f6-672de172fe68 req-3169cf36-3d03-4312-9bd9-5572a4562de7 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e9acc381-a143-444a-97f6-672de172fe68 req-3169cf36-3d03-4312-9bd9-5572a4562de7 service nova] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e9acc381-a143-444a-97f6-672de172fe68 req-3169cf36-3d03-4312-9bd9-5572a4562de7 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e9acc381-a143-444a-97f6-672de172fe68 req-3169cf36-3d03-4312-9bd9-5572a4562de7 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-e9acc381-a143-444a-97f6-672de172fe68 req-3169cf36-3d03-4312-9bd9-5572a4562de7 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] No waiting events found dispatching network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:19 user nova-compute[75813]: WARNING nova.compute.manager [req-e9acc381-a143-444a-97f6-672de172fe68 req-3169cf36-3d03-4312-9bd9-5572a4562de7 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received unexpected event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 for instance with vm_state building and task_state spawning.
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:12:19 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Instance spawned successfully.
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:19 user nova-compute[75813]: INFO nova.compute.manager [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:12:19 user nova-compute[75813]: INFO nova.compute.manager [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Took 6.89 seconds to build instance.
Nov 15 13:12:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-048a7a8e-7548-413e-8ea9-64045f5a33eb tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.999s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.network.neutron [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Successfully updated port: 53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "refresh_cache-6f6b89e1-6387-4cc0-9879-18005298fe74" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquired lock "refresh_cache-6f6b89e1-6387-4cc0-9879-18005298fe74" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.network.neutron [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-5efe707c-4ec2-483d-a11c-b537f3883b65 req-d10727ec-d11e-45bf-9fc5-eff11edd7018 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Received event network-changed-53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-5efe707c-4ec2-483d-a11c-b537f3883b65 req-d10727ec-d11e-45bf-9fc5-eff11edd7018 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Refreshing instance network info cache due to event network-changed-53912f78-e73d-4b82-80c0-85702993fa1b. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5efe707c-4ec2-483d-a11c-b537f3883b65 req-d10727ec-d11e-45bf-9fc5-eff11edd7018 service nova] Acquiring lock "refresh_cache-6f6b89e1-6387-4cc0-9879-18005298fe74" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:12:19 user nova-compute[75813]: DEBUG nova.network.neutron [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:12:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Updating instance_info_cache with network_info: [{"id": "53912f78-e73d-4b82-80c0-85702993fa1b", "address": "fa:16:3e:18:c6:c7", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53912f78-e7", "ovs_interfaceid": "53912f78-e73d-4b82-80c0-85702993fa1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:12:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Releasing lock "refresh_cache-6f6b89e1-6387-4cc0-9879-18005298fe74" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:12:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Instance network_info: |[{"id": "53912f78-e73d-4b82-80c0-85702993fa1b", "address": "fa:16:3e:18:c6:c7", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53912f78-e7", "ovs_interfaceid": "53912f78-e73d-4b82-80c0-85702993fa1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:12:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5efe707c-4ec2-483d-a11c-b537f3883b65 req-d10727ec-d11e-45bf-9fc5-eff11edd7018 service nova] Acquired lock "refresh_cache-6f6b89e1-6387-4cc0-9879-18005298fe74" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:12:20 user nova-compute[75813]: DEBUG nova.network.neutron [req-5efe707c-4ec2-483d-a11c-b537f3883b65 req-d10727ec-d11e-45bf-9fc5-eff11edd7018 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Refreshing network info cache for port 53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:12:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:20 user nova-compute[75813]: DEBUG nova.network.neutron [req-5efe707c-4ec2-483d-a11c-b537f3883b65 req-d10727ec-d11e-45bf-9fc5-eff11edd7018 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Updated VIF entry in instance network info cache for port 53912f78-e73d-4b82-80c0-85702993fa1b. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:12:20 user nova-compute[75813]: DEBUG nova.network.neutron [req-5efe707c-4ec2-483d-a11c-b537f3883b65 req-d10727ec-d11e-45bf-9fc5-eff11edd7018 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Updating instance_info_cache with network_info: [{"id": "53912f78-e73d-4b82-80c0-85702993fa1b", "address": "fa:16:3e:18:c6:c7", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53912f78-e7", "ovs_interfaceid": "53912f78-e73d-4b82-80c0-85702993fa1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:12:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5efe707c-4ec2-483d-a11c-b537f3883b65 req-d10727ec-d11e-45bf-9fc5-eff11edd7018 service nova] Releasing lock "refresh_cache-6f6b89e1-6387-4cc0-9879-18005298fe74" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:12:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.compute.manager [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:12:23 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Creating image(s)
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Ensure instance console log exists: /opt/stack/data/nova/instances/6f6b89e1-6387-4cc0-9879-18005298fe74/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Start _get_guest_xml network_info=[{"id": "53912f78-e73d-4b82-80c0-85702993fa1b", "address": "fa:16:3e:18:c6:c7", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53912f78-e7", "ovs_interfaceid": "53912f78-e73d-4b82-80c0-85702993fa1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'd86e4476-f77b-4569-91f6-9429abe9d1ba', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTXrpRIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f6b89e1-6387-4cc0-9879-18005298fe74', 'attached_at': '', 'detached_at': '', 'volume_id': '58122a0b-746d-4f27-8699-2e20361443c7', 'serial': '58122a0b-746d-4f27-8699-2e20361443c7'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:12:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:12:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTXrpRIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:12:23 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:12:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:12:23 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:12:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:12:23 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:12:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2b42d1-a305-4c7a-9815-2ad617ae4abe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:12:23 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43d5021-dafd-4b5d-bc50-cc36e9dca7ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7] added
Nov 15 13:12:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:12:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44026d0-ab54-4ff8-8848-9794af4fb8b4]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6fe68a-5785-409f-9950-4d7502cfc8ec]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTXrpRIK {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTXrpRIK" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e04f8a1-a82f-4f2f-a7c2-4a125142bb31]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cTXrpRIK'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c23bfed-f78e-482a-b746-b79322936728]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8337624-dfaa-4aee-88b8-1743bdf7873b]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:12:24 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:12:24 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:12:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:12:24 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:12:24 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:12:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a4cd4-6c7d-4d14-a0ef-b76ced7834fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260]
Nov 15 13:12:24 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260] successful.
Nov 15 13:12:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a87711b-3344-4cc9-b037-bfce23f06f91]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fadc82-84cb-4432-9a50-3c79e2604bf0]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:12:24 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:12:24 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:12:24 user nova-compute[75813]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:12:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:12:24 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:12:24 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:12:24 user nova-compute[75813]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:12:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c1fc82-197b-4aa0-ba8e-60f879fb2425]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTXrpRIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:12:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26165393139643064', 'path': '/dev/sdd'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165393139643064', 'path': '/dev/sdd'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1778917430',display_name='tempest-TestVolumeBootPattern-server-1778917430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1778917430',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVAQWHIq9cYMEzcyVYcUoyfR2jxd2gljn//pF8UzTbmKwL/Z5WpRY76WGV9mAg+N+3PLplBlRmOaiMT+tOytqHtvyAtP7F/jIKyI5SH5XjxLhIhN8ZWLbU2OF0/srpA==',key_name='tempest-TestVolumeBootPattern-1181310603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-c9wazqum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:12:19Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=6f6b89e1-6387-4cc0-9879-18005298fe74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53912f78-e73d-4b82-80c0-85702993fa1b", "address": "fa:16:3e:18:c6:c7", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53912f78-e7", "ovs_interfaceid": "53912f78-e73d-4b82-80c0-85702993fa1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "53912f78-e73d-4b82-80c0-85702993fa1b", "address": "fa:16:3e:18:c6:c7", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53912f78-e7", "ovs_interfaceid": "53912f78-e73d-4b82-80c0-85702993fa1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:c6:c7,bridge_name='br-int',has_traffic_filtering=True,id=53912f78-e73d-4b82-80c0-85702993fa1b,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53912f78-e7') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG nova.objects.instance [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f6b89e1-6387-4cc0-9879-18005298fe74 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:12:25 user nova-compute[75813]:   <uuid>6f6b89e1-6387-4cc0-9879-18005298fe74</uuid>
Nov 15 13:12:25 user nova-compute[75813]:   <name>instance-00000028</name>
Nov 15 13:12:25 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:12:25 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:12:25 user nova-compute[75813]:   <metadata>
Nov 15 13:12:25 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:12:25 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:12:25 user nova-compute[75813]:       <nova:name>tempest-TestVolumeBootPattern-server-1778917430</nova:name>
Nov 15 13:12:25 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:12:23</nova:creationTime>
Nov 15 13:12:25 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:12:25 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:12:25 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:12:25 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:12:25 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:12:25 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:12:25 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:12:25 user nova-compute[75813]:       <nova:owner>
Nov 15 13:12:25 user nova-compute[75813]:         <nova:user uuid="3bc41f21cddc40e7a287b6f809233a65">tempest-TestVolumeBootPattern-678819035-project-member</nova:user>
Nov 15 13:12:25 user nova-compute[75813]:         <nova:project uuid="63086918b1c84a608c4a5aebf968eab5">tempest-TestVolumeBootPattern-678819035</nova:project>
Nov 15 13:12:25 user nova-compute[75813]:       </nova:owner>
Nov 15 13:12:25 user nova-compute[75813]:       <nova:ports>
Nov 15 13:12:25 user nova-compute[75813]:         <nova:port uuid="53912f78-e73d-4b82-80c0-85702993fa1b">
Nov 15 13:12:25 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 13:12:25 user nova-compute[75813]:         </nova:port>
Nov 15 13:12:25 user nova-compute[75813]:       </nova:ports>
Nov 15 13:12:25 user nova-compute[75813]:     </nova:instance>
Nov 15 13:12:25 user nova-compute[75813]:   </metadata>
Nov 15 13:12:25 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:12:25 user nova-compute[75813]:     <system>
Nov 15 13:12:25 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:12:25 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:12:25 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:12:25 user nova-compute[75813]:       <entry name="serial">6f6b89e1-6387-4cc0-9879-18005298fe74</entry>
Nov 15 13:12:25 user nova-compute[75813]:       <entry name="uuid">6f6b89e1-6387-4cc0-9879-18005298fe74</entry>
Nov 15 13:12:25 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:12:25 user nova-compute[75813]:     </system>
Nov 15 13:12:25 user nova-compute[75813]:   </sysinfo>
Nov 15 13:12:25 user nova-compute[75813]:   <os>
Nov 15 13:12:25 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:12:25 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:12:25 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:12:25 user nova-compute[75813]:   </os>
Nov 15 13:12:25 user nova-compute[75813]:   <features>
Nov 15 13:12:25 user nova-compute[75813]:     <acpi/>
Nov 15 13:12:25 user nova-compute[75813]:     <apic/>
Nov 15 13:12:25 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:12:25 user nova-compute[75813]:   </features>
Nov 15 13:12:25 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:12:25 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:12:25 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:12:25 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:12:25 user nova-compute[75813]:   </clock>
Nov 15 13:12:25 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:12:25 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:12:25 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:12:25 user nova-compute[75813]:   </cpu>
Nov 15 13:12:25 user nova-compute[75813]:   <devices>
Nov 15 13:12:25 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:12:25 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:12:25 user nova-compute[75813]:       <source dev="/dev/sdd"/>
Nov 15 13:12:25 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:12:25 user nova-compute[75813]:       <serial>58122a0b-746d-4f27-8699-2e20361443c7</serial>
Nov 15 13:12:25 user nova-compute[75813]:     </disk>
Nov 15 13:12:25 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:12:25 user nova-compute[75813]:       <mac address="fa:16:3e:18:c6:c7"/>
Nov 15 13:12:25 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:12:25 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:12:25 user nova-compute[75813]:       <target dev="tap53912f78-e7"/>
Nov 15 13:12:25 user nova-compute[75813]:     </interface>
Nov 15 13:12:25 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:12:25 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/6f6b89e1-6387-4cc0-9879-18005298fe74/console.log" append="off"/>
Nov 15 13:12:25 user nova-compute[75813]:     </serial>
Nov 15 13:12:25 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:12:25 user nova-compute[75813]:     <video>
Nov 15 13:12:25 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:12:25 user nova-compute[75813]:     </video>
Nov 15 13:12:25 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:12:25 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:12:25 user nova-compute[75813]:     </rng>
Nov 15 13:12:25 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:12:25 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:12:25 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:12:25 user nova-compute[75813]:     </memballoon>
Nov 15 13:12:25 user nova-compute[75813]:   </devices>
Nov 15 13:12:25 user nova-compute[75813]: </domain>
Nov 15 13:12:25 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1778917430',display_name='tempest-TestVolumeBootPattern-server-1778917430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1778917430',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVAQWHIq9cYMEzcyVYcUoyfR2jxd2gljn//pF8UzTbmKwL/Z5WpRY76WGV9mAg+N+3PLplBlRmOaiMT+tOytqHtvyAtP7F/jIKyI5SH5XjxLhIhN8ZWLbU2OF0/srpA==',key_name='tempest-TestVolumeBootPattern-1181310603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-c9wazqum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:12:19Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=6f6b89e1-6387-4cc0-9879-18005298fe74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53912f78-e73d-4b82-80c0-85702993fa1b", "address": "fa:16:3e:18:c6:c7", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53912f78-e7", "ovs_interfaceid": "53912f78-e73d-4b82-80c0-85702993fa1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "53912f78-e73d-4b82-80c0-85702993fa1b", "address": "fa:16:3e:18:c6:c7", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53912f78-e7", "ovs_interfaceid": "53912f78-e73d-4b82-80c0-85702993fa1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:c6:c7,bridge_name='br-int',has_traffic_filtering=True,id=53912f78-e73d-4b82-80c0-85702993fa1b,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53912f78-e7') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG os_vif [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c6:c7,bridge_name='br-int',has_traffic_filtering=True,id=53912f78-e73d-4b82-80c0-85702993fa1b,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53912f78-e7') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bda21539-3abd-5733-962e-7e033755c12d', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53912f78-e7, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53912f78-e7, col_values=(('qos', UUID('62816b84-d5a3-4d29-9578-cf9cacf053b1')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53912f78-e7, col_values=(('external_ids', {'iface-id': '53912f78-e73d-4b82-80c0-85702993fa1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:c6:c7', 'vm-uuid': '6f6b89e1-6387-4cc0-9879-18005298fe74'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:25 user nova-compute[75813]: INFO os_vif [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c6:c7,bridge_name='br-int',has_traffic_filtering=True,id=53912f78-e73d-4b82-80c0-85702993fa1b,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53912f78-e7')
Nov 15 13:12:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:12:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No VIF found with MAC fa:16:3e:18:c6:c7, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:12:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-2d3a2b5a-2932-46c5-8bdc-3b456a609626 req-a6dec2a9-878b-4494-b3e9-b5415eb14c4f service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Received event network-vif-plugged-53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2d3a2b5a-2932-46c5-8bdc-3b456a609626 req-a6dec2a9-878b-4494-b3e9-b5415eb14c4f service nova] Acquiring lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2d3a2b5a-2932-46c5-8bdc-3b456a609626 req-a6dec2a9-878b-4494-b3e9-b5415eb14c4f service nova] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2d3a2b5a-2932-46c5-8bdc-3b456a609626 req-a6dec2a9-878b-4494-b3e9-b5415eb14c4f service nova] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-2d3a2b5a-2932-46c5-8bdc-3b456a609626 req-a6dec2a9-878b-4494-b3e9-b5415eb14c4f service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] No waiting events found dispatching network-vif-plugged-53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:26 user nova-compute[75813]: WARNING nova.compute.manager [req-2d3a2b5a-2932-46c5-8bdc-3b456a609626 req-a6dec2a9-878b-4494-b3e9-b5415eb14c4f service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Received unexpected event network-vif-plugged-53912f78-e73d-4b82-80c0-85702993fa1b for instance with vm_state building and task_state spawning.
Nov 15 13:12:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:28 user nova-compute[75813]: INFO nova.compute.manager [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Rescuing
Nov 15 13:12:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:12:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquired lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:12:28 user nova-compute[75813]: DEBUG nova.network.neutron [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-43d720e2-80ed-4f17-8f27-a5c5f2d5339b req-1a2abc55-c1da-48fa-be90-71ed56701f3e service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Received event network-vif-plugged-53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-43d720e2-80ed-4f17-8f27-a5c5f2d5339b req-1a2abc55-c1da-48fa-be90-71ed56701f3e service nova] Acquiring lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-43d720e2-80ed-4f17-8f27-a5c5f2d5339b req-1a2abc55-c1da-48fa-be90-71ed56701f3e service nova] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-43d720e2-80ed-4f17-8f27-a5c5f2d5339b req-1a2abc55-c1da-48fa-be90-71ed56701f3e service nova] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-43d720e2-80ed-4f17-8f27-a5c5f2d5339b req-1a2abc55-c1da-48fa-be90-71ed56701f3e service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] No waiting events found dispatching network-vif-plugged-53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:29 user nova-compute[75813]: WARNING nova.compute.manager [req-43d720e2-80ed-4f17-8f27-a5c5f2d5339b req-1a2abc55-c1da-48fa-be90-71ed56701f3e service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Received unexpected event network-vif-plugged-53912f78-e73d-4b82-80c0-85702993fa1b for instance with vm_state building and task_state spawning.
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:12:29 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Instance spawned successfully.
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:29 user nova-compute[75813]: INFO nova.compute.manager [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:12:29 user nova-compute[75813]: INFO nova.compute.manager [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Took 11.49 seconds to build instance.
Nov 15 13:12:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eac8d6a8-84a9-43b8-8200-8e1ce63862c4 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.586s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.network.neutron [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updating instance_info_cache with network_info: [{"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Releasing lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-670fc96f-ecd5-46e8-8dff-48974e7e593b req-9c22d29b-e100-4edf-b691-e625e6be4120 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-unplugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-670fc96f-ecd5-46e8-8dff-48974e7e593b req-9c22d29b-e100-4edf-b691-e625e6be4120 service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-670fc96f-ecd5-46e8-8dff-48974e7e593b req-9c22d29b-e100-4edf-b691-e625e6be4120 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-670fc96f-ecd5-46e8-8dff-48974e7e593b req-9c22d29b-e100-4edf-b691-e625e6be4120 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-670fc96f-ecd5-46e8-8dff-48974e7e593b req-9c22d29b-e100-4edf-b691-e625e6be4120 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-unplugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:29 user nova-compute[75813]: WARNING nova.compute.manager [req-670fc96f-ecd5-46e8-8dff-48974e7e593b req-9c22d29b-e100-4edf-b691-e625e6be4120 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received unexpected event network-vif-unplugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with vm_state active and task_state rescuing.
Nov 15 13:12:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:30 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: ca55ee20-1155-4312-8508-a223654cd615] Instance destroyed successfully.
Nov 15 13:12:30 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Attempting rescue
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75813) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Instance directory exists: not creating {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 13:12:30 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Creating image(s)
Nov 15 13:12:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.058s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.objects.instance [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'trusted_certs' on Instance uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.202s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.rescue {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.rescue" returned: 0 in 0.060s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.objects.instance [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'migration_context' on Instance uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.objects.base [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<ca55ee20-1155-4312-8508-a223654cd615> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Start _get_guest_xml network_info=[{"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "vif_mac": "fa:16:3e:1b:2f:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4d13142f-f571-4806-9713-890c0afeb458', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.objects.instance [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'resources' on Instance uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.objects.base [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<ca55ee20-1155-4312-8508-a223654cd615> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.objects.instance [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'numa_topology' on Instance uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.objects.base [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<ca55ee20-1155-4312-8508-a223654cd615> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:12:30 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:12:30 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.objects.instance [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.objects.base [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<ca55ee20-1155-4312-8508-a223654cd615> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-988378064',display_name='tempest-ServerRescueNegativeTestJSON-server-988378064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-988378064',id=33,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-81rws25z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:07:54Z,user_data=None,user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=ca55ee20-1155-4312-8508-a223654cd615,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "vif_mac": "fa:16:3e:1b:2f:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "vif_mac": "fa:16:3e:1b:2f:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:2f:d1,bridge_name='br-int',has_traffic_filtering=True,id=ab9960cf-b2b9-45d5-aedd-a314edf7cbe4,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9960cf-b2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.objects.instance [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'pci_devices' on Instance uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.objects.base [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<ca55ee20-1155-4312-8508-a223654cd615> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:12:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:12:30 user nova-compute[75813]:   <uuid>ca55ee20-1155-4312-8508-a223654cd615</uuid>
Nov 15 13:12:30 user nova-compute[75813]:   <name>instance-00000021</name>
Nov 15 13:12:30 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:12:30 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:12:30 user nova-compute[75813]:   <metadata>
Nov 15 13:12:30 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:12:30 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:12:30 user nova-compute[75813]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-988378064</nova:name>
Nov 15 13:12:30 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:12:30</nova:creationTime>
Nov 15 13:12:30 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:12:30 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:12:30 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:12:30 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:12:30 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:12:30 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:12:30 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:12:30 user nova-compute[75813]:       <nova:owner>
Nov 15 13:12:30 user nova-compute[75813]:         <nova:user uuid="754cbdd42e894349bdacf3a0c7ba06cc">tempest-ServerRescueNegativeTestJSON-1475327670-project-member</nova:user>
Nov 15 13:12:30 user nova-compute[75813]:         <nova:project uuid="71da470a3bdb4093bc2b5db0b66fa08e">tempest-ServerRescueNegativeTestJSON-1475327670</nova:project>
Nov 15 13:12:30 user nova-compute[75813]:       </nova:owner>
Nov 15 13:12:30 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:12:30 user nova-compute[75813]:       <nova:ports>
Nov 15 13:12:30 user nova-compute[75813]:         <nova:port uuid="ab9960cf-b2b9-45d5-aedd-a314edf7cbe4">
Nov 15 13:12:30 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 13:12:30 user nova-compute[75813]:         </nova:port>
Nov 15 13:12:30 user nova-compute[75813]:       </nova:ports>
Nov 15 13:12:30 user nova-compute[75813]:     </nova:instance>
Nov 15 13:12:30 user nova-compute[75813]:   </metadata>
Nov 15 13:12:30 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:12:30 user nova-compute[75813]:     <system>
Nov 15 13:12:30 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:12:30 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:12:30 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:12:30 user nova-compute[75813]:       <entry name="serial">ca55ee20-1155-4312-8508-a223654cd615</entry>
Nov 15 13:12:30 user nova-compute[75813]:       <entry name="uuid">ca55ee20-1155-4312-8508-a223654cd615</entry>
Nov 15 13:12:30 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:12:30 user nova-compute[75813]:     </system>
Nov 15 13:12:30 user nova-compute[75813]:   </sysinfo>
Nov 15 13:12:30 user nova-compute[75813]:   <os>
Nov 15 13:12:30 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:12:30 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:12:30 user nova-compute[75813]:   </os>
Nov 15 13:12:30 user nova-compute[75813]:   <features>
Nov 15 13:12:30 user nova-compute[75813]:     <acpi/>
Nov 15 13:12:30 user nova-compute[75813]:     <apic/>
Nov 15 13:12:30 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:12:30 user nova-compute[75813]:   </features>
Nov 15 13:12:30 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:12:30 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:12:30 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:12:30 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:12:30 user nova-compute[75813]:   </clock>
Nov 15 13:12:30 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:12:30 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:12:30 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:12:30 user nova-compute[75813]:   </cpu>
Nov 15 13:12:30 user nova-compute[75813]:   <devices>
Nov 15 13:12:30 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:12:30 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:12:30 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.rescue"/>
Nov 15 13:12:30 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:12:30 user nova-compute[75813]:     </disk>
Nov 15 13:12:30 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:12:30 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:12:30 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk"/>
Nov 15 13:12:30 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 13:12:30 user nova-compute[75813]:     </disk>
Nov 15 13:12:30 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:12:30 user nova-compute[75813]:       <mac address="fa:16:3e:1b:2f:d1"/>
Nov 15 13:12:30 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:12:30 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:12:30 user nova-compute[75813]:       <target dev="tapab9960cf-b2"/>
Nov 15 13:12:30 user nova-compute[75813]:     </interface>
Nov 15 13:12:30 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:12:30 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/console.log" append="off"/>
Nov 15 13:12:30 user nova-compute[75813]:     </serial>
Nov 15 13:12:30 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:12:30 user nova-compute[75813]:     <video>
Nov 15 13:12:30 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:12:30 user nova-compute[75813]:     </video>
Nov 15 13:12:30 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:12:30 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:12:30 user nova-compute[75813]:     </rng>
Nov 15 13:12:30 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:12:30 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:12:30 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:12:30 user nova-compute[75813]:     </memballoon>
Nov 15 13:12:30 user nova-compute[75813]:   </devices>
Nov 15 13:12:30 user nova-compute[75813]: </domain>
Nov 15 13:12:30 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:12:30 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: ca55ee20-1155-4312-8508-a223654cd615] Instance destroyed successfully.
Nov 15 13:12:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:12:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:12:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No VIF found with MAC fa:16:3e:1b:2f:d1, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:12:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-ba7c7391-c344-4236-90a7-f3ce6e971d7d req-adb0e8be-ef90-4af1-a9f8-00cc96cdc373 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ba7c7391-c344-4236-90a7-f3ce6e971d7d req-adb0e8be-ef90-4af1-a9f8-00cc96cdc373 service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ba7c7391-c344-4236-90a7-f3ce6e971d7d req-adb0e8be-ef90-4af1-a9f8-00cc96cdc373 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ba7c7391-c344-4236-90a7-f3ce6e971d7d req-adb0e8be-ef90-4af1-a9f8-00cc96cdc373 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:31 user nova-compute[75813]: DEBUG nova.compute.manager [req-ba7c7391-c344-4236-90a7-f3ce6e971d7d req-adb0e8be-ef90-4af1-a9f8-00cc96cdc373 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:31 user nova-compute[75813]: WARNING nova.compute.manager [req-ba7c7391-c344-4236-90a7-f3ce6e971d7d req-adb0e8be-ef90-4af1-a9f8-00cc96cdc373 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received unexpected event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with vm_state active and task_state rescuing.
Nov 15 13:12:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:34 user nova-compute[75813]: DEBUG nova.compute.manager [None req-40084afe-9b90-4d26-9201-c850b676f79e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:12:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-d295aa35-ef49-4566-b52c-b1ba0a01b504 req-b1317d79-98df-4715-a00f-ffa675eab1d3 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d295aa35-ef49-4566-b52c-b1ba0a01b504 req-b1317d79-98df-4715-a00f-ffa675eab1d3 service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d295aa35-ef49-4566-b52c-b1ba0a01b504 req-b1317d79-98df-4715-a00f-ffa675eab1d3 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d295aa35-ef49-4566-b52c-b1ba0a01b504 req-b1317d79-98df-4715-a00f-ffa675eab1d3 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-d295aa35-ef49-4566-b52c-b1ba0a01b504 req-b1317d79-98df-4715-a00f-ffa675eab1d3 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:35 user nova-compute[75813]: WARNING nova.compute.manager [req-d295aa35-ef49-4566-b52c-b1ba0a01b504 req-b1317d79-98df-4715-a00f-ffa675eab1d3 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received unexpected event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with vm_state rescued and task_state None.
Nov 15 13:12:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-fa59a497-461b-48ad-9c98-e32a7a887456 req-c6dfbabf-ce26-4b03-8cd7-0421012ea95d service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fa59a497-461b-48ad-9c98-e32a7a887456 req-c6dfbabf-ce26-4b03-8cd7-0421012ea95d service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fa59a497-461b-48ad-9c98-e32a7a887456 req-c6dfbabf-ce26-4b03-8cd7-0421012ea95d service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fa59a497-461b-48ad-9c98-e32a7a887456 req-c6dfbabf-ce26-4b03-8cd7-0421012ea95d service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-fa59a497-461b-48ad-9c98-e32a7a887456 req-c6dfbabf-ce26-4b03-8cd7-0421012ea95d service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:37 user nova-compute[75813]: WARNING nova.compute.manager [req-fa59a497-461b-48ad-9c98-e32a7a887456 req-c6dfbabf-ce26-4b03-8cd7-0421012ea95d service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received unexpected event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with vm_state rescued and task_state None.
Nov 15 13:12:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:12:41 user nova-compute[75813]: INFO nova.compute.claims [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Claim successful on node user
Nov 15 13:12:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:41 user nova-compute[75813]: INFO nova.compute.manager [None req-4c5c733b-ce12-4511-9bdd-b2b5484ed2f9 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Unrescuing
Nov 15 13:12:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4c5c733b-ce12-4511-9bdd-b2b5484ed2f9 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4c5c733b-ce12-4511-9bdd-b2b5484ed2f9 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquired lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG nova.network.neutron [None req-4c5c733b-ce12-4511-9bdd-b2b5484ed2f9 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:41 user nova-compute[75813]: DEBUG nova.compute.manager [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-4c5c733b-ce12-4511-9bdd-b2b5484ed2f9 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Updating instance_info_cache with network_info: [{"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:12:42 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4c5c733b-ce12-4511-9bdd-b2b5484ed2f9 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Releasing lock "refresh_cache-25669d63-7812-4e4c-a4ed-0e30f7515510" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.objects.instance [None req-4c5c733b-ce12-4511-9bdd-b2b5484ed2f9 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'flavor' on Instance uuid 25669d63-7812-4e4c-a4ed-0e30f7515510 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.policy [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c260e661d4104e7888fdd3fc4257cc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c994fd1a1654264a408318e33304679', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.compute.manager [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:12:42 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Creating image(s)
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "/opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "/opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "/opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-8b99e3e6-5c22-41b7-9e55-1d723dad21cb req-2e5d6f7b-1e2d-4e64-8aac-625c3ca6d64d service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-unplugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8b99e3e6-5c22-41b7-9e55-1d723dad21cb req-2e5d6f7b-1e2d-4e64-8aac-625c3ca6d64d service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8b99e3e6-5c22-41b7-9e55-1d723dad21cb req-2e5d6f7b-1e2d-4e64-8aac-625c3ca6d64d service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8b99e3e6-5c22-41b7-9e55-1d723dad21cb req-2e5d6f7b-1e2d-4e64-8aac-625c3ca6d64d service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.compute.manager [req-8b99e3e6-5c22-41b7-9e55-1d723dad21cb req-2e5d6f7b-1e2d-4e64-8aac-625c3ca6d64d service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-unplugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:42 user nova-compute[75813]: WARNING nova.compute.manager [req-8b99e3e6-5c22-41b7-9e55-1d723dad21cb req-2e5d6f7b-1e2d-4e64-8aac-625c3ca6d64d service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received unexpected event network-vif-unplugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk 1073741824" returned: 0 in 0.051s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.208s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:12:42 user nova-compute[75813]: DEBUG nova.network.neutron [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Successfully created port: 9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:12:43 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Instance destroyed successfully.
Nov 15 13:12:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Cannot resize image /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Ensure instance console log exists: /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Successfully updated port: 9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquired lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-ff47e52c-9e24-4c98-a2f2-c80649aa2b7a req-1773d8ee-eab7-4d88-ba18-fc3a8fa15cad service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-changed-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG nova.compute.manager [req-ff47e52c-9e24-4c98-a2f2-c80649aa2b7a req-1773d8ee-eab7-4d88-ba18-fc3a8fa15cad service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Refreshing instance network info cache due to event network-changed-9a8f8938-6aaf-4651-be3f-9b96c4ef331c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ff47e52c-9e24-4c98-a2f2-c80649aa2b7a req-1773d8ee-eab7-4d88-ba18-fc3a8fa15cad service nova] Acquiring lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:12:43 user nova-compute[75813]: DEBUG nova.network.neutron [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.network.neutron [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Updating instance_info_cache with network_info: [{"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Releasing lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Instance network_info: |[{"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ff47e52c-9e24-4c98-a2f2-c80649aa2b7a req-1773d8ee-eab7-4d88-ba18-fc3a8fa15cad service nova] Acquired lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.network.neutron [req-ff47e52c-9e24-4c98-a2f2-c80649aa2b7a req-1773d8ee-eab7-4d88-ba18-fc3a8fa15cad service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Refreshing network info cache for port 9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Start _get_guest_xml network_info=[{"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:12:44 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:12:44 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1239040693',display_name='tempest-TestStampPattern-server-1239040693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1239040693',id=41,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLKrkLu7f9w3+U6cD1j5d4t/hb+GATdYey2Mtp5Sm2zl/kk0TYZnXEXQqeVbbwwqJDQaj0o7WXy4ErZdlp6eJTA23hMjmFtD1DfWfDHzibymmApmthDuNQCp3ogmew4qQ==',key_name='tempest-TestStampPattern-1022702423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c994fd1a1654264a408318e33304679',ramdisk_id='',reservation_id='r-ramhahfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1055506233',owner_user_name='tempest-TestStampPattern-1055506233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:12:42Z,user_data=None,user_id='c260e661d4104e7888fdd3fc4257cc4d',uuid=df9506c4-4e3d-432e-9e36-c2308db670eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converting VIF {"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2b:79,bridge_name='br-int',has_traffic_filtering=True,id=9a8f8938-6aaf-4651-be3f-9b96c4ef331c,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8f8938-6a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.objects.instance [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lazy-loading 'pci_devices' on Instance uuid df9506c4-4e3d-432e-9e36-c2308db670eb {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:12:44 user nova-compute[75813]:   <uuid>df9506c4-4e3d-432e-9e36-c2308db670eb</uuid>
Nov 15 13:12:44 user nova-compute[75813]:   <name>instance-00000029</name>
Nov 15 13:12:44 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:12:44 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:12:44 user nova-compute[75813]:   <metadata>
Nov 15 13:12:44 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:12:44 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:12:44 user nova-compute[75813]:       <nova:name>tempest-TestStampPattern-server-1239040693</nova:name>
Nov 15 13:12:44 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:12:44</nova:creationTime>
Nov 15 13:12:44 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:12:44 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:12:44 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:12:44 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:12:44 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:12:44 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:12:44 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:12:44 user nova-compute[75813]:       <nova:owner>
Nov 15 13:12:44 user nova-compute[75813]:         <nova:user uuid="c260e661d4104e7888fdd3fc4257cc4d">tempest-TestStampPattern-1055506233-project-member</nova:user>
Nov 15 13:12:44 user nova-compute[75813]:         <nova:project uuid="0c994fd1a1654264a408318e33304679">tempest-TestStampPattern-1055506233</nova:project>
Nov 15 13:12:44 user nova-compute[75813]:       </nova:owner>
Nov 15 13:12:44 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:12:44 user nova-compute[75813]:       <nova:ports>
Nov 15 13:12:44 user nova-compute[75813]:         <nova:port uuid="9a8f8938-6aaf-4651-be3f-9b96c4ef331c">
Nov 15 13:12:44 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 13:12:44 user nova-compute[75813]:         </nova:port>
Nov 15 13:12:44 user nova-compute[75813]:       </nova:ports>
Nov 15 13:12:44 user nova-compute[75813]:     </nova:instance>
Nov 15 13:12:44 user nova-compute[75813]:   </metadata>
Nov 15 13:12:44 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:12:44 user nova-compute[75813]:     <system>
Nov 15 13:12:44 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:12:44 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:12:44 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:12:44 user nova-compute[75813]:       <entry name="serial">df9506c4-4e3d-432e-9e36-c2308db670eb</entry>
Nov 15 13:12:44 user nova-compute[75813]:       <entry name="uuid">df9506c4-4e3d-432e-9e36-c2308db670eb</entry>
Nov 15 13:12:44 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:12:44 user nova-compute[75813]:     </system>
Nov 15 13:12:44 user nova-compute[75813]:   </sysinfo>
Nov 15 13:12:44 user nova-compute[75813]:   <os>
Nov 15 13:12:44 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:12:44 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:12:44 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:12:44 user nova-compute[75813]:   </os>
Nov 15 13:12:44 user nova-compute[75813]:   <features>
Nov 15 13:12:44 user nova-compute[75813]:     <acpi/>
Nov 15 13:12:44 user nova-compute[75813]:     <apic/>
Nov 15 13:12:44 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:12:44 user nova-compute[75813]:   </features>
Nov 15 13:12:44 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:12:44 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:12:44 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:12:44 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:12:44 user nova-compute[75813]:   </clock>
Nov 15 13:12:44 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:12:44 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:12:44 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:12:44 user nova-compute[75813]:   </cpu>
Nov 15 13:12:44 user nova-compute[75813]:   <devices>
Nov 15 13:12:44 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:12:44 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:12:44 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk"/>
Nov 15 13:12:44 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:12:44 user nova-compute[75813]:     </disk>
Nov 15 13:12:44 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:12:44 user nova-compute[75813]:       <mac address="fa:16:3e:fd:2b:79"/>
Nov 15 13:12:44 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:12:44 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:12:44 user nova-compute[75813]:       <target dev="tap9a8f8938-6a"/>
Nov 15 13:12:44 user nova-compute[75813]:     </interface>
Nov 15 13:12:44 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:12:44 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/console.log" append="off"/>
Nov 15 13:12:44 user nova-compute[75813]:     </serial>
Nov 15 13:12:44 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:12:44 user nova-compute[75813]:     <video>
Nov 15 13:12:44 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:12:44 user nova-compute[75813]:     </video>
Nov 15 13:12:44 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:12:44 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:12:44 user nova-compute[75813]:     </rng>
Nov 15 13:12:44 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:12:44 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:12:44 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:12:44 user nova-compute[75813]:     </memballoon>
Nov 15 13:12:44 user nova-compute[75813]:   </devices>
Nov 15 13:12:44 user nova-compute[75813]: </domain>
Nov 15 13:12:44 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1239040693',display_name='tempest-TestStampPattern-server-1239040693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1239040693',id=41,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLKrkLu7f9w3+U6cD1j5d4t/hb+GATdYey2Mtp5Sm2zl/kk0TYZnXEXQqeVbbwwqJDQaj0o7WXy4ErZdlp6eJTA23hMjmFtD1DfWfDHzibymmApmthDuNQCp3ogmew4qQ==',key_name='tempest-TestStampPattern-1022702423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c994fd1a1654264a408318e33304679',ramdisk_id='',reservation_id='r-ramhahfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1055506233',owner_user_name='tempest-TestStampPattern-1055506233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:12:42Z,user_data=None,user_id='c260e661d4104e7888fdd3fc4257cc4d',uuid=df9506c4-4e3d-432e-9e36-c2308db670eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converting VIF {"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2b:79,bridge_name='br-int',has_traffic_filtering=True,id=9a8f8938-6aaf-4651-be3f-9b96c4ef331c,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8f8938-6a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG os_vif [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2b:79,bridge_name='br-int',has_traffic_filtering=True,id=9a8f8938-6aaf-4651-be3f-9b96c4ef331c,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8f8938-6a') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee6514d3-9e55-5a8d-a5ac-218ea48ba757', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a8f8938-6a, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a8f8938-6a, col_values=(('qos', UUID('b048fe0f-2ea9-4bf0-92da-9fec90852e1c')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a8f8938-6a, col_values=(('external_ids', {'iface-id': '9a8f8938-6aaf-4651-be3f-9b96c4ef331c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:2b:79', 'vm-uuid': 'df9506c4-4e3d-432e-9e36-c2308db670eb'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: INFO os_vif [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2b:79,bridge_name='br-int',has_traffic_filtering=True,id=9a8f8938-6aaf-4651-be3f-9b96c4ef331c,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8f8938-6a')
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-81616dfe-0ce0-4348-adcd-b30dd1edbfe6 req-cfe41d30-4412-4b13-8d71-936861d27caa service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-81616dfe-0ce0-4348-adcd-b30dd1edbfe6 req-cfe41d30-4412-4b13-8d71-936861d27caa service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-81616dfe-0ce0-4348-adcd-b30dd1edbfe6 req-cfe41d30-4412-4b13-8d71-936861d27caa service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-81616dfe-0ce0-4348-adcd-b30dd1edbfe6 req-cfe41d30-4412-4b13-8d71-936861d27caa service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.compute.manager [req-81616dfe-0ce0-4348-adcd-b30dd1edbfe6 req-cfe41d30-4412-4b13-8d71-936861d27caa service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:44 user nova-compute[75813]: WARNING nova.compute.manager [req-81616dfe-0ce0-4348-adcd-b30dd1edbfe6 req-cfe41d30-4412-4b13-8d71-936861d27caa service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received unexpected event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] No VIF found with MAC fa:16:3e:fd:2b:79, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.network.neutron [req-ff47e52c-9e24-4c98-a2f2-c80649aa2b7a req-1773d8ee-eab7-4d88-ba18-fc3a8fa15cad service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Updated VIF entry in instance network info cache for port 9a8f8938-6aaf-4651-be3f-9b96c4ef331c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG nova.network.neutron [req-ff47e52c-9e24-4c98-a2f2-c80649aa2b7a req-1773d8ee-eab7-4d88-ba18-fc3a8fa15cad service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Updating instance_info_cache with network_info: [{"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ff47e52c-9e24-4c98-a2f2-c80649aa2b7a req-1773d8ee-eab7-4d88-ba18-fc3a8fa15cad service nova] Releasing lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:12:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-29ef9585-51c9-4cc0-a54f-d9053ad86d4a req-d8d8ce2d-93a4-48fb-86c6-ff0f63bbfd1e service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-29ef9585-51c9-4cc0-a54f-d9053ad86d4a req-d8d8ce2d-93a4-48fb-86c6-ff0f63bbfd1e service nova] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-29ef9585-51c9-4cc0-a54f-d9053ad86d4a req-d8d8ce2d-93a4-48fb-86c6-ff0f63bbfd1e service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-29ef9585-51c9-4cc0-a54f-d9053ad86d4a req-d8d8ce2d-93a4-48fb-86c6-ff0f63bbfd1e service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-29ef9585-51c9-4cc0-a54f-d9053ad86d4a req-d8d8ce2d-93a4-48fb-86c6-ff0f63bbfd1e service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] No waiting events found dispatching network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:46 user nova-compute[75813]: WARNING nova.compute.manager [req-29ef9585-51c9-4cc0-a54f-d9053ad86d4a req-d8d8ce2d-93a4-48fb-86c6-ff0f63bbfd1e service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received unexpected event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c for instance with vm_state building and task_state spawning.
Nov 15 13:12:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:46 user nova-compute[75813]: WARNING nova.compute.manager [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received unexpected event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:12:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG nova.compute.manager [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:46 user nova-compute[75813]: WARNING nova.compute.manager [req-077409da-96fc-4ffa-89d1-bc88031a0a36 req-5080e663-7f57-4d56-b5a7-1f6094cae473 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received unexpected event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:12:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4c5c733b-ce12-4511-9bdd-b2b5484ed2f9 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:12:48 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Instance spawned successfully.
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:12:48 user nova-compute[75813]: INFO nova.compute.manager [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-02cc6acf-34df-45a9-88bd-222993847b27 req-56417c87-4c42-4a99-a480-c014800d32b0 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-02cc6acf-34df-45a9-88bd-222993847b27 req-56417c87-4c42-4a99-a480-c014800d32b0 service nova] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-02cc6acf-34df-45a9-88bd-222993847b27 req-56417c87-4c42-4a99-a480-c014800d32b0 service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-02cc6acf-34df-45a9-88bd-222993847b27 req-56417c87-4c42-4a99-a480-c014800d32b0 service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-02cc6acf-34df-45a9-88bd-222993847b27 req-56417c87-4c42-4a99-a480-c014800d32b0 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] No waiting events found dispatching network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:12:48 user nova-compute[75813]: WARNING nova.compute.manager [req-02cc6acf-34df-45a9-88bd-222993847b27 req-56417c87-4c42-4a99-a480-c014800d32b0 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received unexpected event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c for instance with vm_state building and task_state spawning.
Nov 15 13:12:48 user nova-compute[75813]: INFO nova.compute.manager [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Took 7.16 seconds to build instance.
Nov 15 13:12:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48dc85c3-4ef0-4332-a2da-6cb31357c0e3 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.286s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:12:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:55 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:12:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:12:57 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:12:57 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:12:57 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:12:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:12:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:12:57 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:12:57 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid 70ddb35e-bc7c-4e18-8028-54496eef0cce {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:12:57 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updating instance_info_cache with network_info: [{"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:12:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-70ddb35e-bc7c-4e18-8028-54496eef0cce" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:12:57 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:12:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:12:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:12:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:00 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:00 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:13:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Going to confirm migration 2 {{(pid=75813) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquired lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG nova.objects.instance [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'info_cache' on Instance uuid 83a338e2-b102-404b-9cbf-730a62aa7e53 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updating instance_info_cache with network_info: [{"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Releasing lock "refresh_cache-83a338e2-b102-404b-9cbf-730a62aa7e53" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG nova.objects.instance [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'migration_context' on Instance uuid 83a338e2-b102-404b-9cbf-730a62aa7e53 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG nova.objects.base [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Object Instance<83a338e2-b102-404b-9cbf-730a62aa7e53> lazy-loaded attributes: info_cache,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.545s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:04 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Deleted allocation for migration 84e6da68-9af6-4d46-98ea-7c60415113c9
Nov 15 13:13:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-473071ae-4129-4d7b-851d-20d205392f35 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.515s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:13:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:13:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:13:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:13:06 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:13:06 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7480MB free_disk=24.72937774658203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca153542-ced0-4884-827f-7af9517b6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 25669d63-7812-4e4c-a4ed-0e30f7515510 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 83a338e2-b102-404b-9cbf-730a62aa7e53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 6f6b89e1-6387-4cc0-9879-18005298fe74 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance df9506c4-4e3d-432e-9e36-c2308db670eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:13:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:13:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:13:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:13:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:13:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:13:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:13:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:13:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:13:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:13:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:13:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:13:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:13:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:13:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:13:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:13:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:13:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:13:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:13:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:13:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:13:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:13:50 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:51 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75813) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 13:13:53 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 13:13:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] There are 0 instances to clean {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 13:13:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:13:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:13:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:13:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:13:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:13:56 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:57 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:57 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:13:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:13:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:13:57 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:13:57 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updating instance_info_cache with network_info: [{"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:13:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-2153a37a-4973-4008-b20c-1bd03dbc39c1" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:13:57 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:13:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:13:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:13:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:14:02 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:14:02 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:14:03 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG nova.objects.instance [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'flavor' on Instance uuid 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:05 user nova-compute[75813]: INFO nova.compute.manager [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Attaching volume ae4f4a31-d390-4907-a0f0-7f919dc9d105 to /dev/vdb
Nov 15 13:14:05 user nova-compute[75813]: DEBUG os_brick.utils [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[60174ac1-52fc-498c-9d74-7d82a4182c8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0b2518-1eab-479a-a2fa-346c4cd0c8a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0acdcb9-4f91-46a6-874f-995d95f6cffe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df2f08d-261c-4367-b127-dad6d9d74ee9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:14:05 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8b6b8d-6bc2-492a-acbb-619b440ea362]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG os_brick.utils [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updating existing volume attachment record: 1185fbe5-3335-42b9-a309-7e03c146d591 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:14:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:14:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:14:08 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:14:08 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7619MB free_disk=24.70062255859375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca153542-ced0-4884-827f-7af9517b6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 25669d63-7812-4e4c-a4ed-0e30f7515510 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 83a338e2-b102-404b-9cbf-730a62aa7e53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 6f6b89e1-6387-4cc0-9879-18005298fe74 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance df9506c4-4e3d-432e-9e36-c2308db670eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing inventories for resource provider 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating ProviderTree inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing aggregate associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, aggregates: None {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing trait associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, traits: HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.817s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:14:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-9c237a51-2460-48cb-9cf5-bc1bbd4e19c5 req-a9322103-5fad-4a5a-9b35-5d808e58f877 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Received event network-changed-53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-9c237a51-2460-48cb-9cf5-bc1bbd4e19c5 req-a9322103-5fad-4a5a-9b35-5d808e58f877 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Refreshing instance network info cache due to event network-changed-53912f78-e73d-4b82-80c0-85702993fa1b. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:14:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c237a51-2460-48cb-9cf5-bc1bbd4e19c5 req-a9322103-5fad-4a5a-9b35-5d808e58f877 service nova] Acquiring lock "refresh_cache-6f6b89e1-6387-4cc0-9879-18005298fe74" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:14:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c237a51-2460-48cb-9cf5-bc1bbd4e19c5 req-a9322103-5fad-4a5a-9b35-5d808e58f877 service nova] Acquired lock "refresh_cache-6f6b89e1-6387-4cc0-9879-18005298fe74" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:14:09 user nova-compute[75813]: DEBUG nova.network.neutron [req-9c237a51-2460-48cb-9cf5-bc1bbd4e19c5 req-a9322103-5fad-4a5a-9b35-5d808e58f877 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Refreshing network info cache for port 53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "6f6b89e1-6387-4cc0-9879-18005298fe74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:10 user nova-compute[75813]: INFO nova.compute.manager [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Terminating instance
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.compute.manager [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.network.neutron [req-9c237a51-2460-48cb-9cf5-bc1bbd4e19c5 req-a9322103-5fad-4a5a-9b35-5d808e58f877 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Updated VIF entry in instance network info cache for port 53912f78-e73d-4b82-80c0-85702993fa1b. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.network.neutron [req-9c237a51-2460-48cb-9cf5-bc1bbd4e19c5 req-a9322103-5fad-4a5a-9b35-5d808e58f877 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Updating instance_info_cache with network_info: [{"id": "53912f78-e73d-4b82-80c0-85702993fa1b", "address": "fa:16:3e:18:c6:c7", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53912f78-e7", "ovs_interfaceid": "53912f78-e73d-4b82-80c0-85702993fa1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c237a51-2460-48cb-9cf5-bc1bbd4e19c5 req-a9322103-5fad-4a5a-9b35-5d808e58f877 service nova] Releasing lock "refresh_cache-6f6b89e1-6387-4cc0-9879-18005298fe74" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZGYbtMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:14:10 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:14:10 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:14:10 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d9b914-4b9c-4ae6-9ee3-f321e2359ec7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:14:10 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2c0bf7-6de1-4926-8841-1225f8d0c7ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105] added
Nov 15 13:14:10 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aa88b4-8721-43fb-89d3-c6267204e995]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ef8034-902a-4ce7-b0f7-8b1dccb273ab]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZGYbtMK {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZGYbtMK" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[054546b1-91c7-46e1-852c-322c5df130d3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VZGYbtMK'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f149474b-14a9-49bd-95aa-d4d7b002b6f5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3276c3d-225c-4d7e-9ada-fdbb1eeda6b5]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:14:10 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:14:10 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-12b5366d-385d-42b2-bfa3-eb0295ab6412 req-7b3a5777-66b7-41d5-b122-ec54f458e226 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Received event network-vif-unplugged-53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-12b5366d-385d-42b2-bfa3-eb0295ab6412 req-7b3a5777-66b7-41d5-b122-ec54f458e226 service nova] Acquiring lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-12b5366d-385d-42b2-bfa3-eb0295ab6412 req-7b3a5777-66b7-41d5-b122-ec54f458e226 service nova] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-12b5366d-385d-42b2-bfa3-eb0295ab6412 req-7b3a5777-66b7-41d5-b122-ec54f458e226 service nova] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-12b5366d-385d-42b2-bfa3-eb0295ab6412 req-7b3a5777-66b7-41d5-b122-ec54f458e226 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] No waiting events found dispatching network-vif-unplugged-53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-12b5366d-385d-42b2-bfa3-eb0295ab6412 req-7b3a5777-66b7-41d5-b122-ec54f458e226 service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Received event network-vif-unplugged-53912f78-e73d-4b82-80c0-85702993fa1b for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c1de5b-9594-4ad5-bace-5adf12c95648]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260]
Nov 15 13:14:10 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260] successful.
Nov 15 13:14:10 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f74657-3dbf-41af-bd7a-61fc74222bdb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9d0270-af8d-4c43-9063-3c4f5d739522]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:10 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:14:10 user nova-compute[75813]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:10 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[223d014e-8dbf-439b-a746-cf0258946006]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZGYbtMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:14:10 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Instance destroyed successfully.
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.objects.instance [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'resources' on Instance uuid 6f6b89e1-6387-4cc0-9879-18005298fe74 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1778917430',display_name='tempest-TestVolumeBootPattern-server-1778917430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1778917430',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVAQWHIq9cYMEzcyVYcUoyfR2jxd2gljn//pF8UzTbmKwL/Z5WpRY76WGV9mAg+N+3PLplBlRmOaiMT+tOytqHtvyAtP7F/jIKyI5SH5XjxLhIhN8ZWLbU2OF0/srpA==',key_name='tempest-TestVolumeBootPattern-1181310603',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:12:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-c9wazqum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:12:29Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=6f6b89e1-6387-4cc0-9879-18005298fe74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53912f78-e73d-4b82-80c0-85702993fa1b", "address": "fa:16:3e:18:c6:c7", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53912f78-e7", "ovs_interfaceid": "53912f78-e73d-4b82-80c0-85702993fa1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "53912f78-e73d-4b82-80c0-85702993fa1b", "address": "fa:16:3e:18:c6:c7", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53912f78-e7", "ovs_interfaceid": "53912f78-e73d-4b82-80c0-85702993fa1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:c6:c7,bridge_name='br-int',has_traffic_filtering=True,id=53912f78-e73d-4b82-80c0-85702993fa1b,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53912f78-e7') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_vif [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c6:c7,bridge_name='br-int',has_traffic_filtering=True,id=53912f78-e73d-4b82-80c0-85702993fa1b,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53912f78-e7') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53912f78-e7, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62816b84-d5a3-4d29-9578-cf9cacf053b1) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:10 user nova-compute[75813]: INFO os_vif [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c6:c7,bridge_name='br-int',has_traffic_filtering=True,id=53912f78-e73d-4b82-80c0-85702993fa1b,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53912f78-e7')
Nov 15 13:14:10 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTXrpRIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:14:10 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:14:10 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23666633032636263', 'path': '/dev/sdf'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666633032636263', 'path': '/dev/sdf'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.651s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG nova.objects.instance [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'flavor' on Instance uuid 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ba4ae-4f00-4b74-813c-0a53d34cc53e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:14:11 user nova-compute[75813]: No targets found.
Nov 15 13:14:11 user nova-compute[75813]: iSNS:
Nov 15 13:14:11 user nova-compute[75813]: No targets found.
Nov 15 13:14:11 user nova-compute[75813]: STATIC:
Nov 15 13:14:11 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105
Nov 15 13:14:11 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:11 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:11 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7
Nov 15 13:14:11 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:11 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:11 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89
Nov 15 13:14:11 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:11 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:11 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:14:11 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:11 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:11 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de
Nov 15 13:14:11 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:11 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:11 user nova-compute[75813]: FIRMWARE:
Nov 15 13:14:11 user nova-compute[75813]: No targets found.
Nov 15 13:14:11 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:14:11 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:14:11 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:14:11 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:14:11 user nova-compute[75813]:   <source dev="/dev/sdf"/>
Nov 15 13:14:11 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:14:11 user nova-compute[75813]:   <serial>ae4f4a31-d390-4907-a0f0-7f919dc9d105</serial>
Nov 15 13:14:11 user nova-compute[75813]: </disk>
Nov 15 13:14:11 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2daed13-4eba-4cab-ab04-14b3ab163abb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83b0b0d-cf86-42aa-a090-d5b59da021b1]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:11 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:11 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:11 user nova-compute[75813]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:14:11 user nova-compute[75813]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:11 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:11 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:11 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:11 user nova-compute[75813]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:14:11 user nova-compute[75813]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:11 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555461a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7'): ({'sdd'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Removing single pathed devices sdd {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73983fc-044f-43f0-ba1a-e056cba12efc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e6dffa-fb1a-4098-a329-30292d9844ee]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flushing IO for device /dev/sdd {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc805b05-6c57-42b1-9cf4-34a391a3a87a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5302737-a664-4aad-9706-6f8f30590958]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab25197-1376-40e7-89f3-bd886389d5ed]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3906e72d-b71f-4f5a-b095-17e295858b5e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260]
Nov 15 13:14:11 user nova-compute[75813]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260] successful.
Nov 15 13:14:11 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dffd4d2-51d8-4dcf-abdf-dc65f03450cb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== disconnect_volume: return (958ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:14:11 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Deleting instance files /opt/stack/data/nova/instances/6f6b89e1-6387-4cc0-9879-18005298fe74_del
Nov 15 13:14:11 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Deletion of /opt/stack/data/nova/instances/6f6b89e1-6387-4cc0-9879-18005298fe74_del complete
Nov 15 13:14:11 user nova-compute[75813]: INFO nova.compute.manager [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Took 1.81 seconds to destroy the instance on the hypervisor.
Nov 15 13:14:11 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:14:11 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:14:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:14:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:14:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] No VIF found with MAC fa:16:3e:c7:07:30, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:14:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-400fa542-47cd-466b-909a-54871fb6fb89 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.896s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-bcd41c5e-97a9-4a6f-9fa0-0e0b9f5c3bd3 req-7d2f54cd-452e-4c1d-b706-5639cdea9b2f service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Received event network-vif-plugged-53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bcd41c5e-97a9-4a6f-9fa0-0e0b9f5c3bd3 req-7d2f54cd-452e-4c1d-b706-5639cdea9b2f service nova] Acquiring lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bcd41c5e-97a9-4a6f-9fa0-0e0b9f5c3bd3 req-7d2f54cd-452e-4c1d-b706-5639cdea9b2f service nova] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bcd41c5e-97a9-4a6f-9fa0-0e0b9f5c3bd3 req-7d2f54cd-452e-4c1d-b706-5639cdea9b2f service nova] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-bcd41c5e-97a9-4a6f-9fa0-0e0b9f5c3bd3 req-7d2f54cd-452e-4c1d-b706-5639cdea9b2f service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] No waiting events found dispatching network-vif-plugged-53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:12 user nova-compute[75813]: WARNING nova.compute.manager [req-bcd41c5e-97a9-4a6f-9fa0-0e0b9f5c3bd3 req-7d2f54cd-452e-4c1d-b706-5639cdea9b2f service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Received unexpected event network-vif-plugged-53912f78-e73d-4b82-80c0-85702993fa1b for instance with vm_state active and task_state deleting.
Nov 15 13:14:12 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:14:12 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Took 0.76 seconds to deallocate network for instance.
Nov 15 13:14:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-b6aab2f6-36b0-4b1f-99ee-6bc556494864 req-7023b78f-4e02-48c0-b489-4eb4b3e89e0b service nova] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Received event network-vif-deleted-53912f78-e73d-4b82-80c0-85702993fa1b {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:13 user nova-compute[75813]: INFO nova.compute.manager [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 6f6b89e1-6387-4cc0-9879-18005298fe74] Took 0.71 seconds to detach 1 volumes for instance.
Nov 15 13:14:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:13 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:14:13 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:14:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:13 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Deleted allocations for instance 6f6b89e1-6387-4cc0-9879-18005298fe74
Nov 15 13:14:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-37257376-71d3-4fdf-9381-6f2a2945c198 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "6f6b89e1-6387-4cc0-9879-18005298fe74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.784s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-2d7b34a2-81c4-412a-95a5-cf56ddc9c2ac req-a57dcad6-3aec-4c1c-9e84-282bff86d838 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-changed-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-2d7b34a2-81c4-412a-95a5-cf56ddc9c2ac req-a57dcad6-3aec-4c1c-9e84-282bff86d838 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Refreshing instance network info cache due to event network-changed-1f078b11-852d-42c3-93f7-9ccacc104851. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:14:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2d7b34a2-81c4-412a-95a5-cf56ddc9c2ac req-a57dcad6-3aec-4c1c-9e84-282bff86d838 service nova] Acquiring lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:14:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2d7b34a2-81c4-412a-95a5-cf56ddc9c2ac req-a57dcad6-3aec-4c1c-9e84-282bff86d838 service nova] Acquired lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:14:16 user nova-compute[75813]: DEBUG nova.network.neutron [req-2d7b34a2-81c4-412a-95a5-cf56ddc9c2ac req-a57dcad6-3aec-4c1c-9e84-282bff86d838 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Refreshing network info cache for port 1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:14:17 user nova-compute[75813]: DEBUG nova.network.neutron [req-2d7b34a2-81c4-412a-95a5-cf56ddc9c2ac req-a57dcad6-3aec-4c1c-9e84-282bff86d838 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updated VIF entry in instance network info cache for port 1f078b11-852d-42c3-93f7-9ccacc104851. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:14:17 user nova-compute[75813]: DEBUG nova.network.neutron [req-2d7b34a2-81c4-412a-95a5-cf56ddc9c2ac req-a57dcad6-3aec-4c1c-9e84-282bff86d838 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updating instance_info_cache with network_info: [{"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:14:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2d7b34a2-81c4-412a-95a5-cf56ddc9c2ac req-a57dcad6-3aec-4c1c-9e84-282bff86d838 service nova] Releasing lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:14:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-94e90ef3-d1b5-4454-aebf-790de1fc008e req-52b3f244-e943-4ac7-a82a-dbccad68ba1b service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-changed-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-94e90ef3-d1b5-4454-aebf-790de1fc008e req-52b3f244-e943-4ac7-a82a-dbccad68ba1b service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Refreshing instance network info cache due to event network-changed-1f078b11-852d-42c3-93f7-9ccacc104851. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:14:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-94e90ef3-d1b5-4454-aebf-790de1fc008e req-52b3f244-e943-4ac7-a82a-dbccad68ba1b service nova] Acquiring lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:14:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-94e90ef3-d1b5-4454-aebf-790de1fc008e req-52b3f244-e943-4ac7-a82a-dbccad68ba1b service nova] Acquired lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:14:18 user nova-compute[75813]: DEBUG nova.network.neutron [req-94e90ef3-d1b5-4454-aebf-790de1fc008e req-52b3f244-e943-4ac7-a82a-dbccad68ba1b service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Refreshing network info cache for port 1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:14:19 user nova-compute[75813]: DEBUG nova.network.neutron [req-94e90ef3-d1b5-4454-aebf-790de1fc008e req-52b3f244-e943-4ac7-a82a-dbccad68ba1b service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updated VIF entry in instance network info cache for port 1f078b11-852d-42c3-93f7-9ccacc104851. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:14:19 user nova-compute[75813]: DEBUG nova.network.neutron [req-94e90ef3-d1b5-4454-aebf-790de1fc008e req-52b3f244-e943-4ac7-a82a-dbccad68ba1b service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updating instance_info_cache with network_info: [{"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:14:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-94e90ef3-d1b5-4454-aebf-790de1fc008e req-52b3f244-e943-4ac7-a82a-dbccad68ba1b service nova] Releasing lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:14:19 user nova-compute[75813]: INFO nova.compute.manager [None req-cc266f68-14b0-4cc5-b96e-6a01effe2204 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Unrescuing
Nov 15 13:14:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc266f68-14b0-4cc5-b96e-6a01effe2204 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:14:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc266f68-14b0-4cc5-b96e-6a01effe2204 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquired lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:14:19 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cc266f68-14b0-4cc5-b96e-6a01effe2204 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cc266f68-14b0-4cc5-b96e-6a01effe2204 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updating instance_info_cache with network_info: [{"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cc266f68-14b0-4cc5-b96e-6a01effe2204 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Releasing lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG nova.objects.instance [None req-cc266f68-14b0-4cc5-b96e-6a01effe2204 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'flavor' on Instance uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-6bbbc2ba-fb28-4e56-b7a2-8399352bbb55 req-fbb78bf6-2749-4cf2-8305-7223b20adf8f service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-unplugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6bbbc2ba-fb28-4e56-b7a2-8399352bbb55 req-fbb78bf6-2749-4cf2-8305-7223b20adf8f service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6bbbc2ba-fb28-4e56-b7a2-8399352bbb55 req-fbb78bf6-2749-4cf2-8305-7223b20adf8f service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6bbbc2ba-fb28-4e56-b7a2-8399352bbb55 req-fbb78bf6-2749-4cf2-8305-7223b20adf8f service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-6bbbc2ba-fb28-4e56-b7a2-8399352bbb55 req-fbb78bf6-2749-4cf2-8305-7223b20adf8f service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-unplugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:20 user nova-compute[75813]: WARNING nova.compute.manager [req-6bbbc2ba-fb28-4e56-b7a2-8399352bbb55 req-fbb78bf6-2749-4cf2-8305-7223b20adf8f service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received unexpected event network-vif-unplugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:14:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: ca55ee20-1155-4312-8508-a223654cd615] Instance destroyed successfully.
Nov 15 13:14:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:21 user nova-compute[75813]: INFO nova.compute.manager [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Rebooting instance
Nov 15 13:14:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:14:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquired lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:14:21 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG nova.network.neutron [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updating instance_info_cache with network_info: [{"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Releasing lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-1fa29ed5-c703-4835-942c-b601babb3cf5 req-6fc00294-1dce-4c3b-825a-a03448821029 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-vif-unplugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1fa29ed5-c703-4835-942c-b601babb3cf5 req-6fc00294-1dce-4c3b-825a-a03448821029 service nova] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1fa29ed5-c703-4835-942c-b601babb3cf5 req-6fc00294-1dce-4c3b-825a-a03448821029 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-1fa29ed5-c703-4835-942c-b601babb3cf5 req-6fc00294-1dce-4c3b-825a-a03448821029 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-1fa29ed5-c703-4835-942c-b601babb3cf5 req-6fc00294-1dce-4c3b-825a-a03448821029 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] No waiting events found dispatching network-vif-unplugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:22 user nova-compute[75813]: WARNING nova.compute.manager [req-1fa29ed5-c703-4835-942c-b601babb3cf5 req-6fc00294-1dce-4c3b-825a-a03448821029 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received unexpected event network-vif-unplugged-1f078b11-852d-42c3-93f7-9ccacc104851 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:23 user nova-compute[75813]: WARNING nova.compute.manager [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received unexpected event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:23 user nova-compute[75813]: WARNING nova.compute.manager [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received unexpected event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.compute.manager [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:23 user nova-compute[75813]: WARNING nova.compute.manager [req-e64f5e9d-b464-4eb5-8f8c-e1ad820ceec1 req-2abd9617-95c1-4eb9-a440-573a63256641 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received unexpected event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:14:23 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Instance destroyed successfully.
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.objects.instance [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'resources' on Instance uuid 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2049584342',display_name='tempest-TestMinimumBasicScenario-server-2049584342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2049584342',id=39,image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa5tjbIEXhETwBangxK8fm82xWdlgvkGh0IwuZr+qf/5VH2hvHWFWMKycuaEXAFhAO+nW6Cesgaj6aMDOYdmbSgXWm4W3KyrShhiUTmG9ZUaj24Gkb/9DIRJ5FiFluMaA==',key_name='tempest-TestMinimumBasicScenario-1466995340',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:12:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5875a3450c054f9490f65fa0a603e699',ramdisk_id='',reservation_id='r-f5yh83em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-651110609',owner_user_name='tempest-TestMinimumBasicScenario-651110609-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:14:22Z,user_data=None,user_id='ea5ceaf286514f268b169a27bbfd4006',uuid=1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converting VIF {"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_vif [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f078b11-85, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db4c71af-1237-47ae-83e7-819cb8337933) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:23 user nova-compute[75813]: INFO os_vif [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85')
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZGYbtMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:14:23 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2af2e44-2d27-4d05-bacf-ebe13d3f96a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:14:23 user nova-compute[75813]: No targets found.
Nov 15 13:14:23 user nova-compute[75813]: iSNS:
Nov 15 13:14:23 user nova-compute[75813]: No targets found.
Nov 15 13:14:23 user nova-compute[75813]: STATIC:
Nov 15 13:14:23 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105
Nov 15 13:14:23 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:23 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:23 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89
Nov 15 13:14:23 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:23 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:23 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:14:23 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:23 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:23 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de
Nov 15 13:14:23 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:23 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:23 user nova-compute[75813]: FIRMWARE:
Nov 15 13:14:23 user nova-compute[75813]: No targets found.
Nov 15 13:14:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:14:23 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:14:23 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4512cfcb-30e8-48df-9c89-97e0596d74a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b36c133-433c-4bc8-9178-aa370e802a08]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:23 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:23 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:23 user nova-compute[75813]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:23 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:23 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:23 user nova-compute[75813]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550255870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105'): ({'sdf'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Removing single pathed devices sdf {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac710cc0-2ef7-47c4-a166-ad201dd479f7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4173ea0-f2be-475f-b577-4e7760f3e261]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Flushing IO for device /dev/sdf {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[456c5f77-03cb-4cc1-8f5b-9527bfcdc33b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5aed30-a0be-44fc-a66d-c8a43a3afd61]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] SCSI volumes sdf have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.071s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e44f30-790e-497a-a857-f74a1e7c0699]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[516e5e92-baf7-446a-9213-bd2a250e1a85]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260]
Nov 15 13:14:23 user nova-compute[75813]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260] successful.
Nov 15 13:14:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3e12c8-6a56-4770-aedc-d33899c142ad]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] <== disconnect_volume: return (385ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Start _get_guest_xml network_info=[{"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': 'ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'attachment_id': '1185fbe5-3335-42b9-a309-7e03c146d591', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZGYbtMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae4f4a31-d390-4907-a0f0-7f919dc9d105', 'serial': 'ae4f4a31-d390-4907-a0f0-7f919dc9d105'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:14:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:14:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.objects.instance [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.objects.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Object Instance<1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf> lazy-loaded attributes: resources,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZGYbtMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:14:23 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:14:23 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:14:23 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a0c6f1-7b33-4566-846e-367a451ff4eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:14:23 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b92d2b2-654d-4a4a-8bc9-1bc2b7e4c0b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105] added
Nov 15 13:14:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af75286-a933-4d5f-b2d8-481e30d7ab93]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d4567b-17a0-4d1f-8c63-43922ce3e8bb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZGYbtMK {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZGYbtMK" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a619b-154e-4ed5-b530-2ff1bfaada05]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VZGYbtMK'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6ca28a-19de-4fde-be66-f433cd60e58c]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b830ba-e769-4fda-a720-014ff4dc4095]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:23 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:23 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:23 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:23 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:23 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:14:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7c72a5-18e4-4027-8e5b-c34dc4970885]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260]
Nov 15 13:14:24 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260] successful.
Nov 15 13:14:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7ce4a7-be5f-4216-8ee0-75fa1236dda2]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a4385a-e747-46e0-9549-3d367de6b8eb]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:24 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:24 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:24 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:24 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:24 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:24 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:24 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd76dbad-a3f8-48c2-91b4-d9c5c83850f0]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZGYbtMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cc266f68-14b0-4cc5-b96e-6a01effe2204 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-ad4bb65e-258e-48e5-bd9a-023bd5c3d9c5 req-38e0eaf4-480c-47de-9d20-cd1d1ae18ceb service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ad4bb65e-258e-48e5-bd9a-023bd5c3d9c5 req-38e0eaf4-480c-47de-9d20-cd1d1ae18ceb service nova] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ad4bb65e-258e-48e5-bd9a-023bd5c3d9c5 req-38e0eaf4-480c-47de-9d20-cd1d1ae18ceb service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ad4bb65e-258e-48e5-bd9a-023bd5c3d9c5 req-38e0eaf4-480c-47de-9d20-cd1d1ae18ceb service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-ad4bb65e-258e-48e5-bd9a-023bd5c3d9c5 req-38e0eaf4-480c-47de-9d20-cd1d1ae18ceb service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] No waiting events found dispatching network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:24 user nova-compute[75813]: WARNING nova.compute.manager [req-ad4bb65e-258e-48e5-bd9a-023bd5c3d9c5 req-38e0eaf4-480c-47de-9d20-cd1d1ae18ceb service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received unexpected event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 13:14:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23666633032636263', 'path': '/dev/sdd'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666633032636263', 'path': '/dev/sdd'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2049584342',display_name='tempest-TestMinimumBasicScenario-server-2049584342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2049584342',id=39,image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa5tjbIEXhETwBangxK8fm82xWdlgvkGh0IwuZr+qf/5VH2hvHWFWMKycuaEXAFhAO+nW6Cesgaj6aMDOYdmbSgXWm4W3KyrShhiUTmG9ZUaj24Gkb/9DIRJ5FiFluMaA==',key_name='tempest-TestMinimumBasicScenario-1466995340',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:12:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5875a3450c054f9490f65fa0a603e699',ramdisk_id='',reservation_id='r-f5yh83em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-651110609',owner_user_name='tempest-TestMinimumBasicScenario-651110609-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:14:22Z,user_data=None,user_id='ea5ceaf286514f268b169a27bbfd4006',uuid=1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converting VIF {"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.objects.instance [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.objects.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Object Instance<1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:14:25 user nova-compute[75813]:   <uuid>1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf</uuid>
Nov 15 13:14:25 user nova-compute[75813]:   <name>instance-00000027</name>
Nov 15 13:14:25 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:14:25 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:14:25 user nova-compute[75813]:   <metadata>
Nov 15 13:14:25 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:14:25 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:14:25 user nova-compute[75813]:       <nova:name>tempest-TestMinimumBasicScenario-server-2049584342</nova:name>
Nov 15 13:14:25 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:14:23</nova:creationTime>
Nov 15 13:14:25 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:14:25 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:14:25 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:14:25 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:14:25 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:14:25 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:14:25 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:14:25 user nova-compute[75813]:       <nova:owner>
Nov 15 13:14:25 user nova-compute[75813]:         <nova:user uuid="ea5ceaf286514f268b169a27bbfd4006">tempest-TestMinimumBasicScenario-651110609-project-member</nova:user>
Nov 15 13:14:25 user nova-compute[75813]:         <nova:project uuid="5875a3450c054f9490f65fa0a603e699">tempest-TestMinimumBasicScenario-651110609</nova:project>
Nov 15 13:14:25 user nova-compute[75813]:       </nova:owner>
Nov 15 13:14:25 user nova-compute[75813]:       <nova:root type="image" uuid="ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4"/>
Nov 15 13:14:25 user nova-compute[75813]:       <nova:ports>
Nov 15 13:14:25 user nova-compute[75813]:         <nova:port uuid="1f078b11-852d-42c3-93f7-9ccacc104851">
Nov 15 13:14:25 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 13:14:25 user nova-compute[75813]:         </nova:port>
Nov 15 13:14:25 user nova-compute[75813]:       </nova:ports>
Nov 15 13:14:25 user nova-compute[75813]:     </nova:instance>
Nov 15 13:14:25 user nova-compute[75813]:   </metadata>
Nov 15 13:14:25 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:14:25 user nova-compute[75813]:     <system>
Nov 15 13:14:25 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:14:25 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:14:25 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:14:25 user nova-compute[75813]:       <entry name="serial">1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf</entry>
Nov 15 13:14:25 user nova-compute[75813]:       <entry name="uuid">1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf</entry>
Nov 15 13:14:25 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:14:25 user nova-compute[75813]:     </system>
Nov 15 13:14:25 user nova-compute[75813]:   </sysinfo>
Nov 15 13:14:25 user nova-compute[75813]:   <os>
Nov 15 13:14:25 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:14:25 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:14:25 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:14:25 user nova-compute[75813]:   </os>
Nov 15 13:14:25 user nova-compute[75813]:   <features>
Nov 15 13:14:25 user nova-compute[75813]:     <acpi/>
Nov 15 13:14:25 user nova-compute[75813]:     <apic/>
Nov 15 13:14:25 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:14:25 user nova-compute[75813]:   </features>
Nov 15 13:14:25 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:14:25 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:14:25 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:14:25 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:14:25 user nova-compute[75813]:   </clock>
Nov 15 13:14:25 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:14:25 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:14:25 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:14:25 user nova-compute[75813]:   </cpu>
Nov 15 13:14:25 user nova-compute[75813]:   <devices>
Nov 15 13:14:25 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:14:25 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:14:25 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk"/>
Nov 15 13:14:25 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:14:25 user nova-compute[75813]:     </disk>
Nov 15 13:14:25 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:14:25 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:14:25 user nova-compute[75813]:       <source dev="/dev/sdd"/>
Nov 15 13:14:25 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 13:14:25 user nova-compute[75813]:       <serial>ae4f4a31-d390-4907-a0f0-7f919dc9d105</serial>
Nov 15 13:14:25 user nova-compute[75813]:     </disk>
Nov 15 13:14:25 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:14:25 user nova-compute[75813]:       <mac address="fa:16:3e:c7:07:30"/>
Nov 15 13:14:25 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:14:25 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:14:25 user nova-compute[75813]:       <target dev="tap1f078b11-85"/>
Nov 15 13:14:25 user nova-compute[75813]:     </interface>
Nov 15 13:14:25 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:14:25 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/console.log" append="off"/>
Nov 15 13:14:25 user nova-compute[75813]:     </serial>
Nov 15 13:14:25 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:14:25 user nova-compute[75813]:     <video>
Nov 15 13:14:25 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:14:25 user nova-compute[75813]:     </video>
Nov 15 13:14:25 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:14:25 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:14:25 user nova-compute[75813]:     </rng>
Nov 15 13:14:25 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:14:25 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:14:25 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:14:25 user nova-compute[75813]:     </memballoon>
Nov 15 13:14:25 user nova-compute[75813]:   </devices>
Nov 15 13:14:25 user nova-compute[75813]: </domain>
Nov 15 13:14:25 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.objects.instance [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.objects.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Object Instance<1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae --force-share --output=json" returned: 0 in 0.221s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Cannot resize image /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.objects.instance [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'migration_context' on Instance uuid 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.objects.base [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Object Instance<1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2049584342',display_name='tempest-TestMinimumBasicScenario-server-2049584342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2049584342',id=39,image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa5tjbIEXhETwBangxK8fm82xWdlgvkGh0IwuZr+qf/5VH2hvHWFWMKycuaEXAFhAO+nW6Cesgaj6aMDOYdmbSgXWm4W3KyrShhiUTmG9ZUaj24Gkb/9DIRJ5FiFluMaA==',key_name='tempest-TestMinimumBasicScenario-1466995340',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:12:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='5875a3450c054f9490f65fa0a603e699',ramdisk_id='',reservation_id='r-f5yh83em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-651110609',owner_user_name='tempest-TestMinimumBasicScenario-651110609-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:14:22Z,user_data=None,user_id='ea5ceaf286514f268b169a27bbfd4006',uuid=1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converting VIF {"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG os_vif [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fff8346b-c201-5cab-8982-17342510e426', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:14:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f078b11-85, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:14:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f078b11-85, col_values=(('qos', UUID('a018a42c-e771-4f05-9b76-d870d493bef9')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:14:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f078b11-85, col_values=(('external_ids', {'iface-id': '1f078b11-852d-42c3-93f7-9ccacc104851', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:07:30', 'vm-uuid': '1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:14:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:14:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:26 user nova-compute[75813]: INFO os_vif [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85')
Nov 15 13:14:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-724ac994-42c1-4d81-9f6c-b67b67318d77 req-8b7692f9-344e-4e95-bb0d-69691ba8bfeb service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-724ac994-42c1-4d81-9f6c-b67b67318d77 req-8b7692f9-344e-4e95-bb0d-69691ba8bfeb service nova] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-724ac994-42c1-4d81-9f6c-b67b67318d77 req-8b7692f9-344e-4e95-bb0d-69691ba8bfeb service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-724ac994-42c1-4d81-9f6c-b67b67318d77 req-8b7692f9-344e-4e95-bb0d-69691ba8bfeb service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:27 user nova-compute[75813]: DEBUG nova.compute.manager [req-724ac994-42c1-4d81-9f6c-b67b67318d77 req-8b7692f9-344e-4e95-bb0d-69691ba8bfeb service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] No waiting events found dispatching network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:27 user nova-compute[75813]: WARNING nova.compute.manager [req-724ac994-42c1-4d81-9f6c-b67b67318d77 req-8b7692f9-344e-4e95-bb0d-69691ba8bfeb service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received unexpected event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 13:14:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-62d2006d-f5f3-471f-b7c8-53f045d6d90b req-e12c726d-b59c-4f62-8cb9-842cf506ccf0 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-62d2006d-f5f3-471f-b7c8-53f045d6d90b req-e12c726d-b59c-4f62-8cb9-842cf506ccf0 service nova] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-62d2006d-f5f3-471f-b7c8-53f045d6d90b req-e12c726d-b59c-4f62-8cb9-842cf506ccf0 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-62d2006d-f5f3-471f-b7c8-53f045d6d90b req-e12c726d-b59c-4f62-8cb9-842cf506ccf0 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:29 user nova-compute[75813]: DEBUG nova.compute.manager [req-62d2006d-f5f3-471f-b7c8-53f045d6d90b req-e12c726d-b59c-4f62-8cb9-842cf506ccf0 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] No waiting events found dispatching network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:29 user nova-compute[75813]: WARNING nova.compute.manager [req-62d2006d-f5f3-471f-b7c8-53f045d6d90b req-e12c726d-b59c-4f62-8cb9-842cf506ccf0 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received unexpected event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 13:14:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:14:29 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Instance rebooted successfully.
Nov 15 13:14:29 user nova-compute[75813]: DEBUG nova.compute.manager [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:14:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-9d3272ca-37b3-49f0-aa25-652ac08ce6b2 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.238s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:32 user nova-compute[75813]: INFO nova.compute.manager [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Terminating instance
Nov 15 13:14:32 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:14:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:33 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Instance destroyed successfully.
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.objects.instance [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'resources' on Instance uuid 25669d63-7812-4e4c-a4ed-0e30f7515510 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2032798804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2032798804',id=37,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-bby005p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:12:48Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=25669d63-7812-4e4c-a4ed-0e30f7515510,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "5224c182-a272-4ff3-86b6-780e6f0f7593", "address": "fa:16:3e:c1:6c:5b", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5224c182-a2", "ovs_interfaceid": "5224c182-a272-4ff3-86b6-780e6f0f7593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=5224c182-a272-4ff3-86b6-780e6f0f7593,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5224c182-a2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_vif [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=5224c182-a272-4ff3-86b6-780e6f0f7593,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5224c182-a2') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5224c182-a2, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82eeb4c1-16d2-4561-b6cd-8180e7660153) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:14:33 user nova-compute[75813]: INFO os_vif [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=5224c182-a272-4ff3-86b6-780e6f0f7593,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5224c182-a2')
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVrKRgcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:14:33 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-2626a4c5-0900-4eea-bb46-c11a5974ec6f req-4311ae2d-0a11-4036-b821-634efec9992a service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-unplugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2626a4c5-0900-4eea-bb46-c11a5974ec6f req-4311ae2d-0a11-4036-b821-634efec9992a service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2626a4c5-0900-4eea-bb46-c11a5974ec6f req-4311ae2d-0a11-4036-b821-634efec9992a service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2626a4c5-0900-4eea-bb46-c11a5974ec6f req-4311ae2d-0a11-4036-b821-634efec9992a service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-2626a4c5-0900-4eea-bb46-c11a5974ec6f req-4311ae2d-0a11-4036-b821-634efec9992a service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-unplugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-2626a4c5-0900-4eea-bb46-c11a5974ec6f req-4311ae2d-0a11-4036-b821-634efec9992a service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-unplugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f6cfd7-cddc-45a1-9c07-53913607f313]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:14:33 user nova-compute[75813]: No targets found.
Nov 15 13:14:33 user nova-compute[75813]: iSNS:
Nov 15 13:14:33 user nova-compute[75813]: No targets found.
Nov 15 13:14:33 user nova-compute[75813]: STATIC:
Nov 15 13:14:33 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105
Nov 15 13:14:33 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:33 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:33 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89
Nov 15 13:14:33 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:33 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:33 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:14:33 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:33 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:33 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de
Nov 15 13:14:33 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:14:33 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:14:33 user nova-compute[75813]: FIRMWARE:
Nov 15 13:14:33 user nova-compute[75813]: No targets found.
Nov 15 13:14:33 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:14:33 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:14:33 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.041s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dca627e-fa0c-4b3f-8424-04e1f8ece418]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b65f6b1-65a4-4d1b-bc50-8e56deb27562]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:33 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:33 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:33 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:33 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:33 user nova-compute[75813]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 (non-flash)
Nov 15 13:14:33 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:33 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:33 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550405ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89'): ({'sde'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Removing single pathed devices sde {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[061d6e9b-ab52-49ae-9ba2-aa700f28bf5f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfcc74e-497a-4952-9528-69f0f17f897a]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flushing IO for device /dev/sde {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a13ec94-8d2f-4703-b240-6e9d5b328610]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9993acb9-7d6c-483d-a830-2f00cb0e37d0]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26561306635613234', '/dev/disk/by-id/scsi-1SCST_BIO7745644a-ea0f5a24fb1598db', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7745644a') {{(pid=87167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[143bff2a-5c1f-4993-a3cf-d48a8db8238e]: (4, None) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[91596226-b4c7-4258-8485-187f56541d16]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2c960e-3b60-4eb7-9a2f-ce610debe353]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89, portal: 172.16.0.220,3260]
Nov 15 13:14:33 user nova-compute[75813]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89, portal: 172.16.0.220,3260] successful.
Nov 15 13:14:33 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba5cb91-40de-4cee-8dde-89cf61962f89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c03c12-4f5e-4023-8220-077da129acb3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] <== disconnect_volume: return (416ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:14:33 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Deleting instance files /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510_del
Nov 15 13:14:33 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Deletion of /opt/stack/data/nova/instances/25669d63-7812-4e4c-a4ed-0e30f7515510_del complete
Nov 15 13:14:33 user nova-compute[75813]: INFO nova.compute.manager [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:33 user nova-compute[75813]: DEBUG nova.objects.instance [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lazy-loading 'flavor' on Instance uuid df9506c4-4e3d-432e-9e36-c2308db670eb {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:34 user nova-compute[75813]: INFO nova.compute.manager [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Attaching volume a719478e-4e26-4927-ad82-bd6a88d405fb to /dev/vdb
Nov 15 13:14:34 user nova-compute[75813]: DEBUG os_brick.utils [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aac152-f639-439f-b571-08a8fef11168]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6285423f-6455-4c84-9598-ba01b591b918]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746471c-9c32-49ff-977c-f0c9d2e5f033]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9865eca2-590c-4c5e-8424-86ffc344650d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:14:34 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:14:34 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8949ae-62f8-4018-8578-925fab97b567]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG os_brick.utils [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Updating existing volume attachment record: 92a5b92d-a3bb-4642-8028-1ca8327a11d8 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:14:34 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Took 0.61 seconds to deallocate network for instance.
Nov 15 13:14:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-2d432680-2299-42c6-9af5-4dc4c5b07acc req-ed3ec67b-0e23-4a9d-82d5-46944594d7b8 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-deleted-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:34 user nova-compute[75813]: INFO nova.compute.manager [req-2d432680-2299-42c6-9af5-4dc4c5b07acc req-ed3ec67b-0e23-4a9d-82d5-46944594d7b8 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Neutron deleted interface 5224c182-a272-4ff3-86b6-780e6f0f7593; detaching it from the instance and deleting it from the info cache
Nov 15 13:14:34 user nova-compute[75813]: DEBUG nova.network.neutron [req-2d432680-2299-42c6-9af5-4dc4c5b07acc req-ed3ec67b-0e23-4a9d-82d5-46944594d7b8 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:14:34 user nova-compute[75813]: DEBUG nova.compute.manager [req-2d432680-2299-42c6-9af5-4dc4c5b07acc req-ed3ec67b-0e23-4a9d-82d5-46944594d7b8 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Detach interface failed, port_id=5224c182-a272-4ff3-86b6-780e6f0f7593, reason: Instance 25669d63-7812-4e4c-a4ed-0e30f7515510 could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-changed-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Refreshing instance network info cache due to event network-changed-9a8f8938-6aaf-4651-be3f-9b96c4ef331c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] Acquiring lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] Acquired lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG nova.network.neutron [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Refreshing network info cache for port 9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG nova.network.neutron [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Updated VIF entry in instance network info cache for port 9a8f8938-6aaf-4651-be3f-9b96c4ef331c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG nova.network.neutron [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Updating instance_info_cache with network_info: [{"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] Releasing lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] No waiting events found dispatching network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:14:35 user nova-compute[75813]: WARNING nova.compute.manager [req-02ee0d23-54c6-4a3a-a86c-541815bc2edc req-77772077-115f-4dd5-abaf-cdce09a85bf4 service nova] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Received unexpected event network-vif-plugged-5224c182-a272-4ff3-86b6-780e6f0f7593 for instance with vm_state active and task_state deleting.
Nov 15 13:14:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:14:38 user nova-compute[75813]: WARNING nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 15 13:14:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 70ddb35e-bc7c-4e18-8028-54496eef0cce {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 2153a37a-4973-4008-b20c-1bd03dbc39c1 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 4ae1ec46-9edc-477d-a9c1-2455a76bda4e {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid ca153542-ced0-4884-827f-7af9517b6d8a {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid eaff87f2-d74c-4e1b-b471-33bd1aeeed34 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 83a338e2-b102-404b-9cbf-730a62aa7e53 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid df9506c4-4e3d-432e-9e36-c2308db670eb {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid 25669d63-7812-4e4c-a4ed-0e30f7515510 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "ca153542-ced0-4884-827f-7af9517b6d8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "ca153542-ced0-4884-827f-7af9517b6d8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "ca55ee20-1155-4312-8508-a223654cd615" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "25669d63-7812-4e4c-a4ed-0e30f7515510" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "ca153542-ced0-4884-827f-7af9517b6d8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "ca55ee20-1155-4312-8508-a223654cd615" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:39 user nova-compute[75813]: INFO nova.compute.manager [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] Took 5.01 seconds to detach 1 volumes for instance.
Nov 15 13:14:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyeOqMbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:14:39 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:14:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:14:39 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:14:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:14:39 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:14:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe8e22b-2cd5-4188-85ee-7f86290109f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:14:39 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:39 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef13b3b-bc88-4656-b61b-697f68dd13a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb] added
Nov 15 13:14:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:40 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Deleted allocations for instance 25669d63-7812-4e4c-a4ed-0e30f7515510
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df8980a-fa81-4144-ac7f-3ae35999b151]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d17115-2717-4a0c-bf35-ac45d3e39bd9]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyeOqMbp {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyeOqMbp" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[106e5c4d-2244-4821-bc5a-afa9b5077cf0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uyeOqMbp'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4a962348-489c-412a-ba5d-958142b6cf80 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.512s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.357s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:40 user nova-compute[75813]: INFO nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 25669d63-7812-4e4c-a4ed-0e30f7515510] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "25669d63-7812-4e4c-a4ed-0e30f7515510" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6231ed-6727-4ffd-8b02-6275cea72714]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec26e45-b622-4678-b510-88d5bd38d6d9]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:40 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:40 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:40 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:40 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[869a9ff4-932f-4cb3-b3f1-0af71e7498bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb, portal: 172.16.0.220,3260]
Nov 15 13:14:40 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb, portal: 172.16.0.220,3260] successful.
Nov 15 13:14:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f598a-2dcf-43f7-bc21-7b34540c5094]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1447806e-6142-4fef-837b-6ad9755dac42]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:40 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:40 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:40 user nova-compute[75813]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb (non-flash)
Nov 15 13:14:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:14:40 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:14:40 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:14:40 user nova-compute[75813]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb (non-flash)
Nov 15 13:14:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80d4101-3500-408f-a97a-bf0c3ff6a0ab]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:14:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyeOqMbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26161366432386239', 'path': '/dev/sde'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161366432386239', 'path': '/dev/sde'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG nova.objects.instance [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lazy-loading 'flavor' on Instance uuid df9506c4-4e3d-432e-9e36-c2308db670eb {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:14:41 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:14:41 user nova-compute[75813]:   <source dev="/dev/sde"/>
Nov 15 13:14:41 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:14:41 user nova-compute[75813]:   <serial>a719478e-4e26-4927-ad82-bd6a88d405fb</serial>
Nov 15 13:14:41 user nova-compute[75813]: </disk>
Nov 15 13:14:41 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] No VIF found with MAC fa:16:3e:fd:2b:79, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-05ce2e60-e4c1-4a58-a0a0-898abf8a7731 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.703s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.108s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:14:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:14:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:14:44 user nova-compute[75813]: INFO nova.compute.manager [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Detaching volume a719478e-4e26-4927-ad82-bd6a88d405fb
Nov 15 13:14:44 user nova-compute[75813]: INFO nova.virt.block_device [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Attempting to driver detach volume a719478e-4e26-4927-ad82-bd6a88d405fb from mountpoint /dev/vdb
Nov 15 13:14:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Attempting to detach device vdb from instance df9506c4-4e3d-432e-9e36-c2308db670eb from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:14:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:14:44 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:14:44 user nova-compute[75813]:   <source dev="/dev/sde"/>
Nov 15 13:14:44 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:14:44 user nova-compute[75813]:   <serial>a719478e-4e26-4927-ad82-bd6a88d405fb</serial>
Nov 15 13:14:44 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:14:44 user nova-compute[75813]: </disk>
Nov 15 13:14:44 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:14:44 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Successfully detached device vdb from instance df9506c4-4e3d-432e-9e36-c2308db670eb from the persistent domain config.
Nov 15 13:14:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df9506c4-4e3d-432e-9e36-c2308db670eb from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:14:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:14:44 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:14:44 user nova-compute[75813]:   <source dev="/dev/sde"/>
Nov 15 13:14:44 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:14:44 user nova-compute[75813]:   <serial>a719478e-4e26-4927-ad82-bd6a88d405fb</serial>
Nov 15 13:14:44 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:14:44 user nova-compute[75813]: </disk>
Nov 15 13:14:44 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:14:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df9506c4-4e3d-432e-9e36-c2308db670eb {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:14:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:53 user nova-compute[75813]: INFO nova.compute.manager [None req-df01993b-ce11-458f-8a69-bbadd4a51edd tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Get console output
Nov 15 13:14:53 user nova-compute[75813]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 13:14:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:57 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:14:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:14:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:14:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:14:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:14:58 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:14:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:14:58 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updating instance_info_cache with network_info: [{"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:14:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-4ae1ec46-9edc-477d-a9c1-2455a76bda4e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:14:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:15:00 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:15:00 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:15:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "c8711110-3a8f-4f80-b991-4061faaaa2d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:15:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:01 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:15:01 user nova-compute[75813]: INFO nova.compute.claims [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Claim successful on node user
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:15:02 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:15:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG nova.policy [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bc41f21cddc40e7a287b6f809233a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63086918b1c84a608c4a5aebf968eab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:15:02 user nova-compute[75813]: INFO nova.virt.block_device [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Booting with volume 58122a0b-746d-4f27-8699-2e20361443c7 at /dev/vda
Nov 15 13:15:02 user nova-compute[75813]: DEBUG os_brick.utils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a57856e-f352-4cc9-9810-6d6eb5e09a35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[255b6302-7698-4f89-8f29-c1966992ba65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6248bd-d8f4-47bf-9d3e-af5ede2bb590]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[befcd6f8-a47d-40fe-87fc-071d3207afe1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:15:02 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:15:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ae5e3e-2353-4bf2-bd2a-3d7ca1b98816]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG os_brick.utils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Updating existing volume attachment record: 615e561c-d90c-4c6d-9dd0-922c7880bdf1 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:15:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Successfully created port: ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Successfully updated port: ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquired lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-3bd039dc-642c-4a46-8c04-e55e6fe9b814 req-019d2809-aa08-4091-b5f1-ce7e103ec279 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received event network-changed-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-3bd039dc-642c-4a46-8c04-e55e6fe9b814 req-019d2809-aa08-4091-b5f1-ce7e103ec279 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Refreshing instance network info cache due to event network-changed-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3bd039dc-642c-4a46-8c04-e55e6fe9b814 req-019d2809-aa08-4091-b5f1-ce7e103ec279 service nova] Acquiring lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Updating instance_info_cache with network_info: [{"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Releasing lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Instance network_info: |[{"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3bd039dc-642c-4a46-8c04-e55e6fe9b814 req-019d2809-aa08-4091-b5f1-ce7e103ec279 service nova] Acquired lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:15:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-3bd039dc-642c-4a46-8c04-e55e6fe9b814 req-019d2809-aa08-4091-b5f1-ce7e103ec279 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Refreshing network info cache for port ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:15:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:15:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:15:04 user nova-compute[75813]: DEBUG nova.network.neutron [req-3bd039dc-642c-4a46-8c04-e55e6fe9b814 req-019d2809-aa08-4091-b5f1-ce7e103ec279 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Updated VIF entry in instance network info cache for port ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:15:04 user nova-compute[75813]: DEBUG nova.network.neutron [req-3bd039dc-642c-4a46-8c04-e55e6fe9b814 req-019d2809-aa08-4091-b5f1-ce7e103ec279 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Updating instance_info_cache with network_info: [{"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:15:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3bd039dc-642c-4a46-8c04-e55e6fe9b814 req-019d2809-aa08-4091-b5f1-ce7e103ec279 service nova] Releasing lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:15:05 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance df9506c4-4e3d-432e-9e36-c2308db670eb is timed out.
Nov 15 13:15:05 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Successfully detached device vdb from instance df9506c4-4e3d-432e-9e36-c2308db670eb from the live domain config.
Nov 15 13:15:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyeOqMbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:15:05 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6985e690-153b-4872-8b20-cb8853dd54af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:15:05 user nova-compute[75813]: No targets found.
Nov 15 13:15:05 user nova-compute[75813]: iSNS:
Nov 15 13:15:05 user nova-compute[75813]: No targets found.
Nov 15 13:15:05 user nova-compute[75813]: STATIC:
Nov 15 13:15:05 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105
Nov 15 13:15:05 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:15:05 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:15:05 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:15:05 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:15:05 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:15:05 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de
Nov 15 13:15:05 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:15:05 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:15:05 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb
Nov 15 13:15:05 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:15:05 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:15:05 user nova-compute[75813]: FIRMWARE:
Nov 15 13:15:05 user nova-compute[75813]: No targets found.
Nov 15 13:15:05 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:15:05 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:15:05 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4e48dd-d118-44e8-8159-58fd7bf4b1d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3091658b-359c-4e8c-9d9e-c038b51ab65e]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:15:05 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:15:05 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:15:05 user nova-compute[75813]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb (non-flash)
Nov 15 13:15:05 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:15:05 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:15:05 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:15:05 user nova-compute[75813]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb (non-flash)
Nov 15 13:15:05 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55501483a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb'): ({'sde'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Removing single pathed devices sde {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d95ba24-e0b2-47b0-8db0-d129337df754]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc259260-5fea-4d0c-977f-3889ac6c5f58]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Flushing IO for device /dev/sde {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e5d1ef-ee4e-4710-91b0-8e5cc6736d54]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3c714d-b3c3-4a82-af25-f0429f0330a1]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e465be9a-5734-49da-8c30-7c504774b9e6]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83b6bb9-262e-489d-ae0a-8dbb48f2c553]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb, portal: 172.16.0.220,3260]
Nov 15 13:15:05 user nova-compute[75813]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb, portal: 172.16.0.220,3260] successful.
Nov 15 13:15:05 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a719478e-4e26-4927-ad82-bd6a88d405fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87ee1c4-9ee3-474a-809a-046787ea03d7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] <== disconnect_volume: return (317ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:15:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.objects.instance [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lazy-loading 'flavor' on Instance uuid df9506c4-4e3d-432e-9e36-c2308db670eb {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6efc10f-195f-4023-8701-d916f94ece4a tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.042s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:15:07 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Creating image(s)
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Ensure instance console log exists: /opt/stack/data/nova/instances/c8711110-3a8f-4f80-b991-4061faaaa2d8/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Start _get_guest_xml network_info=[{"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': '615e561c-d90c-4c6d-9dd0-922c7880bdf1', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTXrpRIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8711110-3a8f-4f80-b991-4061faaaa2d8', 'attached_at': '', 'detached_at': '', 'volume_id': '58122a0b-746d-4f27-8699-2e20361443c7', 'serial': '58122a0b-746d-4f27-8699-2e20361443c7'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:15:07 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:15:07 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTXrpRIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:15:07 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:15:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:15:07 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:15:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:15:07 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5491bc-c3bc-4c87-9e89-86b5d54a5190]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:15:07 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2412fc76-f5fd-4d3c-be67-4175d1c6bb73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7] added
Nov 15 13:15:07 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb6a38b-8bdd-4bd9-b96c-dfd199e27d88]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75618ae-c8fd-444b-8e3a-ba453f4c7643]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTXrpRIK {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTXrpRIK" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d48a13-ebb5-47d6-a652-cd1299cd2bba]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cTXrpRIK'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00ebeac-7c0e-437d-a508-842ac29ddb2e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac86bee-3f6b-4dd0-b734-92dc32931073]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:15:08 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:15:08 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:15:08 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:15:08 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:15:08 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:15:08 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e32335-0228-44dd-91b0-a230573a5f0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260]
Nov 15 13:15:08 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260] successful.
Nov 15 13:15:08 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa02b92d-83a7-4b86-aca1-c1d60201e70e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35bc33d-92f9-47fb-8d1f-265cd0e70ad2]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:15:08 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:15:08 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:15:08 user nova-compute[75813]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:15:08 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:15:08 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:15:08 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:15:08 user nova-compute[75813]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:15:08 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] HCTL ('36', '-', '-', 0) found on session 52 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[37baf387-e60e-4190-b146-8df5bc8d8781]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTXrpRIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.713s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== connect_volume: return (1715ms) {'type': 'block', 'scsi_wwn': '26165393139643064', 'path': '/dev/sde'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165393139643064', 'path': '/dev/sde'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:15:09 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:15:09 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7861MB free_disk=24.6884765625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1138692525',display_name='tempest-TestVolumeBootPattern-server-1138692525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1138692525',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVAQWHIq9cYMEzcyVYcUoyfR2jxd2gljn//pF8UzTbmKwL/Z5WpRY76WGV9mAg+N+3PLplBlRmOaiMT+tOytqHtvyAtP7F/jIKyI5SH5XjxLhIhN8ZWLbU2OF0/srpA==',key_name='tempest-TestVolumeBootPattern-1181310603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-zxbydrfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:15:02Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=c8711110-3a8f-4f80-b991-4061faaaa2d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:62:11,bridge_name='br-int',has_traffic_filtering=True,id=ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb2cc47-ae') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.objects.instance [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'pci_devices' on Instance uuid c8711110-3a8f-4f80-b991-4061faaaa2d8 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:15:09 user nova-compute[75813]:   <uuid>c8711110-3a8f-4f80-b991-4061faaaa2d8</uuid>
Nov 15 13:15:09 user nova-compute[75813]:   <name>instance-0000002a</name>
Nov 15 13:15:09 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:15:09 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:15:09 user nova-compute[75813]:   <metadata>
Nov 15 13:15:09 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:15:09 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:15:09 user nova-compute[75813]:       <nova:name>tempest-TestVolumeBootPattern-server-1138692525</nova:name>
Nov 15 13:15:09 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:15:07</nova:creationTime>
Nov 15 13:15:09 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:15:09 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:15:09 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:15:09 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:15:09 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:15:09 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:15:09 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:15:09 user nova-compute[75813]:       <nova:owner>
Nov 15 13:15:09 user nova-compute[75813]:         <nova:user uuid="3bc41f21cddc40e7a287b6f809233a65">tempest-TestVolumeBootPattern-678819035-project-member</nova:user>
Nov 15 13:15:09 user nova-compute[75813]:         <nova:project uuid="63086918b1c84a608c4a5aebf968eab5">tempest-TestVolumeBootPattern-678819035</nova:project>
Nov 15 13:15:09 user nova-compute[75813]:       </nova:owner>
Nov 15 13:15:09 user nova-compute[75813]:       <nova:ports>
Nov 15 13:15:09 user nova-compute[75813]:         <nova:port uuid="ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c">
Nov 15 13:15:09 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 13:15:09 user nova-compute[75813]:         </nova:port>
Nov 15 13:15:09 user nova-compute[75813]:       </nova:ports>
Nov 15 13:15:09 user nova-compute[75813]:     </nova:instance>
Nov 15 13:15:09 user nova-compute[75813]:   </metadata>
Nov 15 13:15:09 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:15:09 user nova-compute[75813]:     <system>
Nov 15 13:15:09 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:15:09 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:15:09 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:15:09 user nova-compute[75813]:       <entry name="serial">c8711110-3a8f-4f80-b991-4061faaaa2d8</entry>
Nov 15 13:15:09 user nova-compute[75813]:       <entry name="uuid">c8711110-3a8f-4f80-b991-4061faaaa2d8</entry>
Nov 15 13:15:09 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:15:09 user nova-compute[75813]:     </system>
Nov 15 13:15:09 user nova-compute[75813]:   </sysinfo>
Nov 15 13:15:09 user nova-compute[75813]:   <os>
Nov 15 13:15:09 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:15:09 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:15:09 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:15:09 user nova-compute[75813]:   </os>
Nov 15 13:15:09 user nova-compute[75813]:   <features>
Nov 15 13:15:09 user nova-compute[75813]:     <acpi/>
Nov 15 13:15:09 user nova-compute[75813]:     <apic/>
Nov 15 13:15:09 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:15:09 user nova-compute[75813]:   </features>
Nov 15 13:15:09 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:15:09 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:15:09 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:15:09 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:15:09 user nova-compute[75813]:   </clock>
Nov 15 13:15:09 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:15:09 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:15:09 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:15:09 user nova-compute[75813]:   </cpu>
Nov 15 13:15:09 user nova-compute[75813]:   <devices>
Nov 15 13:15:09 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:15:09 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:15:09 user nova-compute[75813]:       <source dev="/dev/sde"/>
Nov 15 13:15:09 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:15:09 user nova-compute[75813]:       <serial>58122a0b-746d-4f27-8699-2e20361443c7</serial>
Nov 15 13:15:09 user nova-compute[75813]:     </disk>
Nov 15 13:15:09 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:15:09 user nova-compute[75813]:       <mac address="fa:16:3e:3e:62:11"/>
Nov 15 13:15:09 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:15:09 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:15:09 user nova-compute[75813]:       <target dev="tapddb2cc47-ae"/>
Nov 15 13:15:09 user nova-compute[75813]:     </interface>
Nov 15 13:15:09 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:15:09 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/c8711110-3a8f-4f80-b991-4061faaaa2d8/console.log" append="off"/>
Nov 15 13:15:09 user nova-compute[75813]:     </serial>
Nov 15 13:15:09 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:15:09 user nova-compute[75813]:     <video>
Nov 15 13:15:09 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:15:09 user nova-compute[75813]:     </video>
Nov 15 13:15:09 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:15:09 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:15:09 user nova-compute[75813]:     </rng>
Nov 15 13:15:09 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:15:09 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:15:09 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:15:09 user nova-compute[75813]:     </memballoon>
Nov 15 13:15:09 user nova-compute[75813]:   </devices>
Nov 15 13:15:09 user nova-compute[75813]: </domain>
Nov 15 13:15:09 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1138692525',display_name='tempest-TestVolumeBootPattern-server-1138692525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1138692525',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVAQWHIq9cYMEzcyVYcUoyfR2jxd2gljn//pF8UzTbmKwL/Z5WpRY76WGV9mAg+N+3PLplBlRmOaiMT+tOytqHtvyAtP7F/jIKyI5SH5XjxLhIhN8ZWLbU2OF0/srpA==',key_name='tempest-TestVolumeBootPattern-1181310603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-zxbydrfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:15:02Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=c8711110-3a8f-4f80-b991-4061faaaa2d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:62:11,bridge_name='br-int',has_traffic_filtering=True,id=ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb2cc47-ae') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG os_vif [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:62:11,bridge_name='br-int',has_traffic_filtering=True,id=ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb2cc47-ae') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4f326e7-98bd-5f1e-8402-dd301c2d3a77', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddb2cc47-ae, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddb2cc47-ae, col_values=(('qos', UUID('7f08b704-816b-4378-94ca-ae5d6d10e025')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddb2cc47-ae, col_values=(('external_ids', {'iface-id': 'ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:62:11', 'vm-uuid': 'c8711110-3a8f-4f80-b991-4061faaaa2d8'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:09 user nova-compute[75813]: INFO os_vif [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:62:11,bridge_name='br-int',has_traffic_filtering=True,id=ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb2cc47-ae')
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca153542-ced0-4884-827f-7af9517b6d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 83a338e2-b102-404b-9cbf-730a62aa7e53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance df9506c4-4e3d-432e-9e36-c2308db670eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance c8711110-3a8f-4f80-b991-4061faaaa2d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:15:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No VIF found with MAC fa:16:3e:3e:62:11, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:15:10 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:15:10 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:15:10 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:15:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:11 user nova-compute[75813]: DEBUG nova.compute.manager [req-a3828b84-75f1-4318-a93c-59596acbf3ca req-aa384861-5f7b-46b3-ac14-e8cd112cec7d service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received event network-vif-plugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a3828b84-75f1-4318-a93c-59596acbf3ca req-aa384861-5f7b-46b3-ac14-e8cd112cec7d service nova] Acquiring lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a3828b84-75f1-4318-a93c-59596acbf3ca req-aa384861-5f7b-46b3-ac14-e8cd112cec7d service nova] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a3828b84-75f1-4318-a93c-59596acbf3ca req-aa384861-5f7b-46b3-ac14-e8cd112cec7d service nova] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:11 user nova-compute[75813]: DEBUG nova.compute.manager [req-a3828b84-75f1-4318-a93c-59596acbf3ca req-aa384861-5f7b-46b3-ac14-e8cd112cec7d service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] No waiting events found dispatching network-vif-plugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:15:11 user nova-compute[75813]: WARNING nova.compute.manager [req-a3828b84-75f1-4318-a93c-59596acbf3ca req-aa384861-5f7b-46b3-ac14-e8cd112cec7d service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received unexpected event network-vif-plugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c for instance with vm_state building and task_state spawning.
Nov 15 13:15:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:15:13 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Instance spawned successfully.
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:15:13 user nova-compute[75813]: INFO nova.compute.manager [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:15:13 user nova-compute[75813]: INFO nova.compute.manager [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Took 11.50 seconds to build instance.
Nov 15 13:15:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4e3aca66-f264-4a9a-b4a3-27dc38a11120 tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.595s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-fb917932-dbf9-4de7-9d42-501afd6d6674 req-65550689-c385-49ee-9756-ff04b6e16e9f service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received event network-vif-plugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fb917932-dbf9-4de7-9d42-501afd6d6674 req-65550689-c385-49ee-9756-ff04b6e16e9f service nova] Acquiring lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fb917932-dbf9-4de7-9d42-501afd6d6674 req-65550689-c385-49ee-9756-ff04b6e16e9f service nova] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-fb917932-dbf9-4de7-9d42-501afd6d6674 req-65550689-c385-49ee-9756-ff04b6e16e9f service nova] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-fb917932-dbf9-4de7-9d42-501afd6d6674 req-65550689-c385-49ee-9756-ff04b6e16e9f service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] No waiting events found dispatching network-vif-plugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:15:13 user nova-compute[75813]: WARNING nova.compute.manager [req-fb917932-dbf9-4de7-9d42-501afd6d6674 req-65550689-c385-49ee-9756-ff04b6e16e9f service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received unexpected event network-vif-plugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c for instance with vm_state active and task_state None.
Nov 15 13:15:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "ca153542-ced0-4884-827f-7af9517b6d8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "ca153542-ced0-4884-827f-7af9517b6d8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:23 user nova-compute[75813]: INFO nova.compute.manager [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Terminating instance
Nov 15 13:15:23 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:15:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-2538993d-0240-452f-99a9-ad87b70d76c8 req-985ab09d-0a26-4017-bd0e-4f09ec407b22 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Received event network-vif-unplugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2538993d-0240-452f-99a9-ad87b70d76c8 req-985ab09d-0a26-4017-bd0e-4f09ec407b22 service nova] Acquiring lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2538993d-0240-452f-99a9-ad87b70d76c8 req-985ab09d-0a26-4017-bd0e-4f09ec407b22 service nova] Lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2538993d-0240-452f-99a9-ad87b70d76c8 req-985ab09d-0a26-4017-bd0e-4f09ec407b22 service nova] Lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-2538993d-0240-452f-99a9-ad87b70d76c8 req-985ab09d-0a26-4017-bd0e-4f09ec407b22 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] No waiting events found dispatching network-vif-unplugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-2538993d-0240-452f-99a9-ad87b70d76c8 req-985ab09d-0a26-4017-bd0e-4f09ec407b22 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Received event network-vif-unplugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:24 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Instance destroyed successfully.
Nov 15 13:15:24 user nova-compute[75813]: DEBUG nova.objects.instance [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'resources' on Instance uuid ca153542-ced0-4884-827f-7af9517b6d8a {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1185003820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1185003820',id=31,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:06:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-7uo4re8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:07:58Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=ca153542-ced0-4884-827f-7af9517b6d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "address": "fa:16:3e:53:76:4d", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46e2aba-da", "ovs_interfaceid": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "address": "fa:16:3e:53:76:4d", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46e2aba-da", "ovs_interfaceid": "a46e2aba-da03-4727-a2c5-90c8ad7f05ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:76:4d,bridge_name='br-int',has_traffic_filtering=True,id=a46e2aba-da03-4727-a2c5-90c8ad7f05ef,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46e2aba-da') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG os_vif [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:76:4d,bridge_name='br-int',has_traffic_filtering=True,id=a46e2aba-da03-4727-a2c5-90c8ad7f05ef,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46e2aba-da') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa46e2aba-da, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93de73ea-6bbb-4fba-ac7f-72f89c0ce8a4) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:24 user nova-compute[75813]: INFO os_vif [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:76:4d,bridge_name='br-int',has_traffic_filtering=True,id=a46e2aba-da03-4727-a2c5-90c8ad7f05ef,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46e2aba-da')
Nov 15 13:15:24 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Deleting instance files /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a_del
Nov 15 13:15:24 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Deletion of /opt/stack/data/nova/instances/ca153542-ced0-4884-827f-7af9517b6d8a_del complete
Nov 15 13:15:24 user nova-compute[75813]: INFO nova.compute.manager [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 13:15:24 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:15:24 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:15:25 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:15:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-5a194507-7b5a-4c62-9094-6f2bf43ebdfb req-247cc97b-b51e-40e5-b10e-2465f3d91e35 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Received event network-vif-deleted-a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:25 user nova-compute[75813]: INFO nova.compute.manager [req-5a194507-7b5a-4c62-9094-6f2bf43ebdfb req-247cc97b-b51e-40e5-b10e-2465f3d91e35 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Neutron deleted interface a46e2aba-da03-4727-a2c5-90c8ad7f05ef; detaching it from the instance and deleting it from the info cache
Nov 15 13:15:25 user nova-compute[75813]: DEBUG nova.network.neutron [req-5a194507-7b5a-4c62-9094-6f2bf43ebdfb req-247cc97b-b51e-40e5-b10e-2465f3d91e35 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:15:25 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Took 0.45 seconds to deallocate network for instance.
Nov 15 13:15:25 user nova-compute[75813]: DEBUG nova.compute.manager [req-5a194507-7b5a-4c62-9094-6f2bf43ebdfb req-247cc97b-b51e-40e5-b10e-2465f3d91e35 service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Detach interface failed, port_id=a46e2aba-da03-4727-a2c5-90c8ad7f05ef, reason: Instance ca153542-ced0-4884-827f-7af9517b6d8a could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 13:15:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:25 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:15:25 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:15:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:25 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Deleted allocations for instance ca153542-ced0-4884-827f-7af9517b6d8a
Nov 15 13:15:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8e7931b3-af76-46eb-8cc1-f26019987e67 tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "ca153542-ced0-4884-827f-7af9517b6d8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.842s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-f3b4785f-6094-4f6c-a701-e565ef70a9b5 req-3310732b-8755-46ab-8b57-2f4b7028692f service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Received event network-vif-plugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f3b4785f-6094-4f6c-a701-e565ef70a9b5 req-3310732b-8755-46ab-8b57-2f4b7028692f service nova] Acquiring lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f3b4785f-6094-4f6c-a701-e565ef70a9b5 req-3310732b-8755-46ab-8b57-2f4b7028692f service nova] Lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f3b4785f-6094-4f6c-a701-e565ef70a9b5 req-3310732b-8755-46ab-8b57-2f4b7028692f service nova] Lock "ca153542-ced0-4884-827f-7af9517b6d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:26 user nova-compute[75813]: DEBUG nova.compute.manager [req-f3b4785f-6094-4f6c-a701-e565ef70a9b5 req-3310732b-8755-46ab-8b57-2f4b7028692f service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] No waiting events found dispatching network-vif-plugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:15:26 user nova-compute[75813]: WARNING nova.compute.manager [req-f3b4785f-6094-4f6c-a701-e565ef70a9b5 req-3310732b-8755-46ab-8b57-2f4b7028692f service nova] [instance: ca153542-ced0-4884-827f-7af9517b6d8a] Received unexpected event network-vif-plugged-a46e2aba-da03-4727-a2c5-90c8ad7f05ef for instance with vm_state deleted and task_state None.
Nov 15 13:15:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:15:38 user nova-compute[75813]: INFO nova.compute.manager [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] instance snapshotting
Nov 15 13:15:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Beginning live snapshot process
Nov 15 13:15:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json -f qcow2 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json -f qcow2 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpugdn3_ck/adb1ac6ba076494492f76196a27fe247.delta 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:38 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpugdn3_ck/adb1ac6ba076494492f76196a27fe247.delta 1073741824" returned: 0 in 0.049s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 13:15:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 13:15:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75813) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 13:15:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 13:15:40 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:15:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpugdn3_ck/adb1ac6ba076494492f76196a27fe247.delta /opt/stack/data/nova/instances/snapshots/tmpugdn3_ck/adb1ac6ba076494492f76196a27fe247 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpugdn3_ck/adb1ac6ba076494492f76196a27fe247.delta /opt/stack/data/nova/instances/snapshots/tmpugdn3_ck/adb1ac6ba076494492f76196a27fe247" returned: 0 in 0.276s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Snapshot extracted, beginning image upload
Nov 15 13:15:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:42 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Snapshot image upload complete
Nov 15 13:15:42 user nova-compute[75813]: INFO nova.compute.manager [None req-159b32e7-35bd-44c3-951d-8b7934cf8322 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Took 4.84 seconds to snapshot the instance on the hypervisor.
Nov 15 13:15:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "3496e335-49df-4457-ae6d-c8c8a655277e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:44 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:15:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:44 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:15:44 user nova-compute[75813]: INFO nova.compute.claims [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Claim successful on node user
Nov 15 13:15:45 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG nova.network.neutron [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:15:45 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:15:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG nova.policy [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c260e661d4104e7888fdd3fc4257cc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c994fd1a1654264a408318e33304679', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:15:45 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Creating image(s)
Nov 15 13:15:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "/opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "/opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "/opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "d13d8426b9ae3eb2defdd35e9089d6f64b798704" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "d13d8426b9ae3eb2defdd35e9089d6f64b798704" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704.part --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:46 user nova-compute[75813]: DEBUG nova.network.neutron [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Successfully created port: c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:15:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:46 user nova-compute[75813]: DEBUG nova.virt.images [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] 98fd0e32-61e3-4093-9a9c-ec7829759fc3 was qcow2, converting to raw {{(pid=75813) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 13:15:46 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:15:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704.part /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704.converted {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704.part /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704.converted" returned: 0 in 0.226s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:46 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704.converted --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "d13d8426b9ae3eb2defdd35e9089d6f64b798704" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.568s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Successfully updated port: c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquired lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-b87ae378-810a-43ba-8d87-c8bc3d33e7cd req-c1ff6333-c2bb-456a-95e2-217d53efe820 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received event network-changed-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-b87ae378-810a-43ba-8d87-c8bc3d33e7cd req-c1ff6333-c2bb-456a-95e2-217d53efe820 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Refreshing instance network info cache due to event network-changed-c873abf1-01f9-42ec-a4b1-d22cd83f8716. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b87ae378-810a-43ba-8d87-c8bc3d33e7cd req-c1ff6333-c2bb-456a-95e2-217d53efe820 service nova] Acquiring lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704 --force-share --output=json" returned: 0 in 0.210s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "d13d8426b9ae3eb2defdd35e9089d6f64b798704" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "d13d8426b9ae3eb2defdd35e9089d6f64b798704" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704 --force-share --output=json" returned: 0 in 0.165s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704,backing_fmt=raw /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704,backing_fmt=raw /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk 1073741824" returned: 0 in 0.046s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "d13d8426b9ae3eb2defdd35e9089d6f64b798704" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704 --force-share --output=json" returned: 0 in 0.167s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Ensure instance console log exists: /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.network.neutron [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Updating instance_info_cache with network_info: [{"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Releasing lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Instance network_info: |[{"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b87ae378-810a-43ba-8d87-c8bc3d33e7cd req-c1ff6333-c2bb-456a-95e2-217d53efe820 service nova] Acquired lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.network.neutron [req-b87ae378-810a-43ba-8d87-c8bc3d33e7cd req-c1ff6333-c2bb-456a-95e2-217d53efe820 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Refreshing network info cache for port c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Start _get_guest_xml network_info=[{"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='75fc9b06a75abaf850b052d74ffa3e97',container_format='bare',created_at=2023-11-15T13:15:38Z,direct_url=<?>,disk_format='qcow2',id=98fd0e32-61e3-4093-9a9c-ec7829759fc3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1306253808',owner='0c994fd1a1654264a408318e33304679',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T13:15:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '98fd0e32-61e3-4093-9a9c-ec7829759fc3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:15:47 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:15:47 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='75fc9b06a75abaf850b052d74ffa3e97',container_format='bare',created_at=2023-11-15T13:15:38Z,direct_url=<?>,disk_format='qcow2',id=98fd0e32-61e3-4093-9a9c-ec7829759fc3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1306253808',owner='0c994fd1a1654264a408318e33304679',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T13:15:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-816695242',display_name='tempest-TestStampPattern-server-816695242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-816695242',id=43,image_ref='98fd0e32-61e3-4093-9a9c-ec7829759fc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLKrkLu7f9w3+U6cD1j5d4t/hb+GATdYey2Mtp5Sm2zl/kk0TYZnXEXQqeVbbwwqJDQaj0o7WXy4ErZdlp6eJTA23hMjmFtD1DfWfDHzibymmApmthDuNQCp3ogmew4qQ==',key_name='tempest-TestStampPattern-1022702423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c994fd1a1654264a408318e33304679',ramdisk_id='',reservation_id='r-ftfu6ben',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='df9506c4-4e3d-432e-9e36-c2308db670eb',image_min_disk='1',image_min_ram='0',image_owner_id='0c994fd1a1654264a408318e33304679',image_owner_project_name='tempest-TestStampPattern-1055506233',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1055506233-project-member',image_user_id='c260e661d4104e7888fdd3fc4257cc4d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1055506233',owner_user_name='tempest-TestStampPattern-1055506233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:15:46Z,user_data=None,user_id='c260e661d4104e7888fdd3fc4257cc4d',uuid=3496e335-49df-4457-ae6d-c8c8a655277e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converting VIF {"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:57:12,bridge_name='br-int',has_traffic_filtering=True,id=c873abf1-01f9-42ec-a4b1-d22cd83f8716,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc873abf1-01') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.objects.instance [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lazy-loading 'pci_devices' on Instance uuid 3496e335-49df-4457-ae6d-c8c8a655277e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:15:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:15:47 user nova-compute[75813]:   <uuid>3496e335-49df-4457-ae6d-c8c8a655277e</uuid>
Nov 15 13:15:47 user nova-compute[75813]:   <name>instance-0000002b</name>
Nov 15 13:15:47 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:15:47 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:15:47 user nova-compute[75813]:   <metadata>
Nov 15 13:15:47 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:15:47 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:15:47 user nova-compute[75813]:       <nova:name>tempest-TestStampPattern-server-816695242</nova:name>
Nov 15 13:15:47 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:15:47</nova:creationTime>
Nov 15 13:15:47 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:15:47 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:15:47 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:15:47 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:15:47 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:15:47 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:15:47 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:15:47 user nova-compute[75813]:       <nova:owner>
Nov 15 13:15:47 user nova-compute[75813]:         <nova:user uuid="c260e661d4104e7888fdd3fc4257cc4d">tempest-TestStampPattern-1055506233-project-member</nova:user>
Nov 15 13:15:47 user nova-compute[75813]:         <nova:project uuid="0c994fd1a1654264a408318e33304679">tempest-TestStampPattern-1055506233</nova:project>
Nov 15 13:15:47 user nova-compute[75813]:       </nova:owner>
Nov 15 13:15:47 user nova-compute[75813]:       <nova:root type="image" uuid="98fd0e32-61e3-4093-9a9c-ec7829759fc3"/>
Nov 15 13:15:47 user nova-compute[75813]:       <nova:ports>
Nov 15 13:15:47 user nova-compute[75813]:         <nova:port uuid="c873abf1-01f9-42ec-a4b1-d22cd83f8716">
Nov 15 13:15:47 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 13:15:47 user nova-compute[75813]:         </nova:port>
Nov 15 13:15:47 user nova-compute[75813]:       </nova:ports>
Nov 15 13:15:47 user nova-compute[75813]:     </nova:instance>
Nov 15 13:15:47 user nova-compute[75813]:   </metadata>
Nov 15 13:15:47 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:15:47 user nova-compute[75813]:     <system>
Nov 15 13:15:47 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:15:47 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:15:47 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:15:47 user nova-compute[75813]:       <entry name="serial">3496e335-49df-4457-ae6d-c8c8a655277e</entry>
Nov 15 13:15:47 user nova-compute[75813]:       <entry name="uuid">3496e335-49df-4457-ae6d-c8c8a655277e</entry>
Nov 15 13:15:47 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:15:47 user nova-compute[75813]:     </system>
Nov 15 13:15:47 user nova-compute[75813]:   </sysinfo>
Nov 15 13:15:47 user nova-compute[75813]:   <os>
Nov 15 13:15:47 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:15:47 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:15:47 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:15:47 user nova-compute[75813]:   </os>
Nov 15 13:15:47 user nova-compute[75813]:   <features>
Nov 15 13:15:47 user nova-compute[75813]:     <acpi/>
Nov 15 13:15:47 user nova-compute[75813]:     <apic/>
Nov 15 13:15:47 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:15:47 user nova-compute[75813]:   </features>
Nov 15 13:15:47 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:15:47 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:15:47 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:15:47 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:15:47 user nova-compute[75813]:   </clock>
Nov 15 13:15:47 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:15:47 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:15:47 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:15:47 user nova-compute[75813]:   </cpu>
Nov 15 13:15:47 user nova-compute[75813]:   <devices>
Nov 15 13:15:47 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:15:47 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:15:47 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk"/>
Nov 15 13:15:47 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:15:47 user nova-compute[75813]:     </disk>
Nov 15 13:15:47 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:15:47 user nova-compute[75813]:       <mac address="fa:16:3e:42:57:12"/>
Nov 15 13:15:47 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:15:47 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:15:47 user nova-compute[75813]:       <target dev="tapc873abf1-01"/>
Nov 15 13:15:47 user nova-compute[75813]:     </interface>
Nov 15 13:15:47 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:15:47 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/console.log" append="off"/>
Nov 15 13:15:47 user nova-compute[75813]:     </serial>
Nov 15 13:15:47 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:15:47 user nova-compute[75813]:     <video>
Nov 15 13:15:47 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:15:47 user nova-compute[75813]:     </video>
Nov 15 13:15:47 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:15:47 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:15:47 user nova-compute[75813]:     </rng>
Nov 15 13:15:47 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:15:47 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:15:47 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:15:47 user nova-compute[75813]:     </memballoon>
Nov 15 13:15:47 user nova-compute[75813]:   </devices>
Nov 15 13:15:47 user nova-compute[75813]: </domain>
Nov 15 13:15:47 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-816695242',display_name='tempest-TestStampPattern-server-816695242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-816695242',id=43,image_ref='98fd0e32-61e3-4093-9a9c-ec7829759fc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLKrkLu7f9w3+U6cD1j5d4t/hb+GATdYey2Mtp5Sm2zl/kk0TYZnXEXQqeVbbwwqJDQaj0o7WXy4ErZdlp6eJTA23hMjmFtD1DfWfDHzibymmApmthDuNQCp3ogmew4qQ==',key_name='tempest-TestStampPattern-1022702423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c994fd1a1654264a408318e33304679',ramdisk_id='',reservation_id='r-ftfu6ben',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='df9506c4-4e3d-432e-9e36-c2308db670eb',image_min_disk='1',image_min_ram='0',image_owner_id='0c994fd1a1654264a408318e33304679',image_owner_project_name='tempest-TestStampPattern-1055506233',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1055506233-project-member',image_user_id='c260e661d4104e7888fdd3fc4257cc4d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1055506233',owner_user_name='tempest-TestStampPattern-1055506233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:15:46Z,user_data=None,user_id='c260e661d4104e7888fdd3fc4257cc4d',uuid=3496e335-49df-4457-ae6d-c8c8a655277e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converting VIF {"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:57:12,bridge_name='br-int',has_traffic_filtering=True,id=c873abf1-01f9-42ec-a4b1-d22cd83f8716,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc873abf1-01') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG os_vif [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:57:12,bridge_name='br-int',has_traffic_filtering=True,id=c873abf1-01f9-42ec-a4b1-d22cd83f8716,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc873abf1-01') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a260c4f3-3311-5477-b997-2a8ef8f0b8b8', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc873abf1-01, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc873abf1-01, col_values=(('qos', UUID('2efbbcc9-dffe-4044-b41f-91948b973822')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc873abf1-01, col_values=(('external_ids', {'iface-id': 'c873abf1-01f9-42ec-a4b1-d22cd83f8716', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:57:12', 'vm-uuid': '3496e335-49df-4457-ae6d-c8c8a655277e'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:48 user nova-compute[75813]: INFO os_vif [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:57:12,bridge_name='br-int',has_traffic_filtering=True,id=c873abf1-01f9-42ec-a4b1-d22cd83f8716,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc873abf1-01')
Nov 15 13:15:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] No VIF found with MAC fa:16:3e:42:57:12, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-b87ae378-810a-43ba-8d87-c8bc3d33e7cd req-c1ff6333-c2bb-456a-95e2-217d53efe820 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Updated VIF entry in instance network info cache for port c873abf1-01f9-42ec-a4b1-d22cd83f8716. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-b87ae378-810a-43ba-8d87-c8bc3d33e7cd req-c1ff6333-c2bb-456a-95e2-217d53efe820 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Updating instance_info_cache with network_info: [{"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:15:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b87ae378-810a-43ba-8d87-c8bc3d33e7cd req-c1ff6333-c2bb-456a-95e2-217d53efe820 service nova] Releasing lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:15:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-3eb01b86-c513-499c-ac61-42b58305d463 req-da7acdb8-6fe5-4355-82e8-94c595cd4e08 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received event network-vif-plugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3eb01b86-c513-499c-ac61-42b58305d463 req-da7acdb8-6fe5-4355-82e8-94c595cd4e08 service nova] Acquiring lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3eb01b86-c513-499c-ac61-42b58305d463 req-da7acdb8-6fe5-4355-82e8-94c595cd4e08 service nova] Lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3eb01b86-c513-499c-ac61-42b58305d463 req-da7acdb8-6fe5-4355-82e8-94c595cd4e08 service nova] Lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-3eb01b86-c513-499c-ac61-42b58305d463 req-da7acdb8-6fe5-4355-82e8-94c595cd4e08 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] No waiting events found dispatching network-vif-plugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:15:49 user nova-compute[75813]: WARNING nova.compute.manager [req-3eb01b86-c513-499c-ac61-42b58305d463 req-da7acdb8-6fe5-4355-82e8-94c595cd4e08 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received unexpected event network-vif-plugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 for instance with vm_state building and task_state spawning.
Nov 15 13:15:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:15:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:15:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Instance spawned successfully.
Nov 15 13:15:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:15:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:15:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:15:51 user nova-compute[75813]: INFO nova.compute.manager [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 15 13:15:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:15:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:51 user nova-compute[75813]: INFO nova.compute.manager [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Took 6.68 seconds to build instance.
Nov 15 13:15:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6084d3c3-3ac9-4564-b0be-6478357d8867 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.003s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-5c214a40-8380-45f1-bb0c-effaaf3d3e8b req-389f7311-dee0-4205-adb9-0c73e5c965ca service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received event network-vif-plugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c214a40-8380-45f1-bb0c-effaaf3d3e8b req-389f7311-dee0-4205-adb9-0c73e5c965ca service nova] Acquiring lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c214a40-8380-45f1-bb0c-effaaf3d3e8b req-389f7311-dee0-4205-adb9-0c73e5c965ca service nova] Lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c214a40-8380-45f1-bb0c-effaaf3d3e8b req-389f7311-dee0-4205-adb9-0c73e5c965ca service nova] Lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-5c214a40-8380-45f1-bb0c-effaaf3d3e8b req-389f7311-dee0-4205-adb9-0c73e5c965ca service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] No waiting events found dispatching network-vif-plugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:15:51 user nova-compute[75813]: WARNING nova.compute.manager [req-5c214a40-8380-45f1-bb0c-effaaf3d3e8b req-389f7311-dee0-4205-adb9-0c73e5c965ca service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received unexpected event network-vif-plugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 for instance with vm_state active and task_state None.
Nov 15 13:15:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:54 user nova-compute[75813]: INFO nova.compute.manager [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Terminating instance
Nov 15 13:15:54 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-af3142fb-d10a-43a9-9dcb-481d9f479bc2 req-9d430589-02d7-412e-a50e-ba1b1e2fd966 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-vif-unplugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-af3142fb-d10a-43a9-9dcb-481d9f479bc2 req-9d430589-02d7-412e-a50e-ba1b1e2fd966 service nova] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-af3142fb-d10a-43a9-9dcb-481d9f479bc2 req-9d430589-02d7-412e-a50e-ba1b1e2fd966 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-af3142fb-d10a-43a9-9dcb-481d9f479bc2 req-9d430589-02d7-412e-a50e-ba1b1e2fd966 service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-af3142fb-d10a-43a9-9dcb-481d9f479bc2 req-9d430589-02d7-412e-a50e-ba1b1e2fd966 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] No waiting events found dispatching network-vif-unplugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-af3142fb-d10a-43a9-9dcb-481d9f479bc2 req-9d430589-02d7-412e-a50e-ba1b1e2fd966 service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-vif-unplugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:54 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:55 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Instance destroyed successfully.
Nov 15 13:15:55 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'resources' on Instance uuid 83a338e2-b102-404b-9cbf-730a62aa7e53 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1229970695',display_name='tempest-ServerActionsTestOtherA-server-1229970695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1229970695',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVScCZLXI8rlN2zoy2tMpAv6grzq+Q7BUD3jx/c9Ws+QNGWvOGcy9SrrC2M21ruqsJkGVx6GSsSkIbkFK6Q0lAtOU+eEFXMzxHts/+TJKb69Xyco0mKWaJkDc6A3DpPzg==',key_name='tempest-keypair-21661059',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:11:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-g37n7g8z',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=83a338e2-b102-404b-9cbf-730a62aa7e53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "address": "fa:16:3e:1a:ca:82", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf18cc9-6a", "ovs_interfaceid": "ccf18cc9-6aa6-4822-b7e4-e7f635a34e78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_vif [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccf18cc9-6a, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f54124b1-893e-43bf-9b59-3c9d0d177c93) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:15:55 user nova-compute[75813]: INFO os_vif [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ca:82,bridge_name='br-int',has_traffic_filtering=True,id=ccf18cc9-6aa6-4822-b7e4-e7f635a34e78,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf18cc9-6a')
Nov 15 13:15:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiOkrRng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:15:55 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4618334-308c-428b-8ebe-91d9e4c0449d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:15:55 user nova-compute[75813]: No targets found.
Nov 15 13:15:55 user nova-compute[75813]: iSNS:
Nov 15 13:15:55 user nova-compute[75813]: No targets found.
Nov 15 13:15:55 user nova-compute[75813]: STATIC:
Nov 15 13:15:55 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105
Nov 15 13:15:55 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:15:55 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:15:55 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7
Nov 15 13:15:55 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:15:55 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:15:55 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:15:55 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:15:55 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:15:55 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de
Nov 15 13:15:55 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:15:55 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:15:55 user nova-compute[75813]: FIRMWARE:
Nov 15 13:15:55 user nova-compute[75813]: No targets found.
Nov 15 13:15:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:15:55 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:15:55 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b956ff0b-c92f-4596-acfd-1a24c8f4ad2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c591175c-9a08-4772-b965-642d23e4442d]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:15:55 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:15:55 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:15:55 user nova-compute[75813]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:15:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:15:55 user nova-compute[75813]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de (non-flash)
Nov 15 13:15:55 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:15:55 user nova-compute[75813]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:15:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5530453d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95a4620-843a-46e3-964d-2f891a994d86]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fb1e75-413e-4b8a-af65-fbb1c623d8d9]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd30202-5599-4db0-9a4f-c4c40beef402]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.066s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88742c4-13b9-43e4-a801-ade15d9ecd8d]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26232316639393030', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_688856e2', '/dev/disk/by-id/scsi-1SCST_BIO688856e2-b21f9900d5b85c0a') {{(pid=87167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4b02e2-af3c-4ed1-bab3-748d8cf5758f]: (4, None) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e018d686-823b-4408-a904-58e43a8609b4]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2501ee-de5f-4b2c-af51-76a3a66e3161]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260]
Nov 15 13:15:55 user nova-compute[75813]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de, portal: 172.16.0.220,3260] successful.
Nov 15 13:15:55 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a528844-d052-432d-8404-01af09570740]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] <== disconnect_volume: return (355ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:15:55 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Deleting instance files /opt/stack/data/nova/instances/83a338e2-b102-404b-9cbf-730a62aa7e53_del
Nov 15 13:15:55 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Deletion of /opt/stack/data/nova/instances/83a338e2-b102-404b-9cbf-730a62aa7e53_del complete
Nov 15 13:15:55 user nova-compute[75813]: INFO nova.compute.manager [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 15 13:15:55 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:15:55 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:15:56 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:15:56 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Took 0.79 seconds to deallocate network for instance.
Nov 15 13:15:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-c4dc374f-2a2c-4a37-b889-b3096420e283 req-624d8f5a-5f4d-4f41-9f0d-2fb25630cbcc service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c4dc374f-2a2c-4a37-b889-b3096420e283 req-624d8f5a-5f4d-4f41-9f0d-2fb25630cbcc service nova] Acquiring lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c4dc374f-2a2c-4a37-b889-b3096420e283 req-624d8f5a-5f4d-4f41-9f0d-2fb25630cbcc service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c4dc374f-2a2c-4a37-b889-b3096420e283 req-624d8f5a-5f4d-4f41-9f0d-2fb25630cbcc service nova] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-c4dc374f-2a2c-4a37-b889-b3096420e283 req-624d8f5a-5f4d-4f41-9f0d-2fb25630cbcc service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] No waiting events found dispatching network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:15:56 user nova-compute[75813]: WARNING nova.compute.manager [req-c4dc374f-2a2c-4a37-b889-b3096420e283 req-624d8f5a-5f4d-4f41-9f0d-2fb25630cbcc service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received unexpected event network-vif-plugged-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 for instance with vm_state active and task_state deleting.
Nov 15 13:15:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-c4dc374f-2a2c-4a37-b889-b3096420e283 req-624d8f5a-5f4d-4f41-9f0d-2fb25630cbcc service nova] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Received event network-vif-deleted-ccf18cc9-6aa6-4822-b7e4-e7f635a34e78 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:15:57 user nova-compute[75813]: INFO nova.compute.manager [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 13:15:57 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 83a338e2-b102-404b-9cbf-730a62aa7e53] Deleting volume: 33559f8c-d9b1-4d7b-bbfd-f3cabea0e0de {{(pid=75813) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 13:15:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:15:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:15:57 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:15:57 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:15:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:57 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Deleted allocations for instance 83a338e2-b102-404b-9cbf-730a62aa7e53
Nov 15 13:15:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d8a15d15-ec28-4e43-8f0f-d1404ed49704 tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "83a338e2-b102-404b-9cbf-730a62aa7e53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.464s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:15:58 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:15:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:15:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:15:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:15:58 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca55ee20-1155-4312-8508-a223654cd615] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:15:58 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updating instance_info_cache with network_info: [{"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:15:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:15:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:15:59 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:16:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:01 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:16:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:16:03 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:16:03 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:16:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:16:05 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:16:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:16:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:16:08 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:16:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:09 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:11 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:16:11 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=7943MB free_disk=24.666728973388672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 70ddb35e-bc7c-4e18-8028-54496eef0cce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2153a37a-4973-4008-b20c-1bd03dbc39c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance df9506c4-4e3d-432e-9e36-c2308db670eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance c8711110-3a8f-4f80-b991-4061faaaa2d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 3496e335-49df-4457-ae6d-c8c8a655277e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:16:11 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:16:12 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:16:12 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:16:12 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:16:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-b0bf8ab2-1644-44a2-84d4-27a387f2971d req-96da5a1b-5c8f-4120-bd77-798712927d03 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-changed-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-b0bf8ab2-1644-44a2-84d4-27a387f2971d req-96da5a1b-5c8f-4120-bd77-798712927d03 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Refreshing instance network info cache due to event network-changed-1f078b11-852d-42c3-93f7-9ccacc104851. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:16:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b0bf8ab2-1644-44a2-84d4-27a387f2971d req-96da5a1b-5c8f-4120-bd77-798712927d03 service nova] Acquiring lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:16:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b0bf8ab2-1644-44a2-84d4-27a387f2971d req-96da5a1b-5c8f-4120-bd77-798712927d03 service nova] Acquired lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:16:13 user nova-compute[75813]: DEBUG nova.network.neutron [req-b0bf8ab2-1644-44a2-84d4-27a387f2971d req-96da5a1b-5c8f-4120-bd77-798712927d03 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Refreshing network info cache for port 1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.network.neutron [req-b0bf8ab2-1644-44a2-84d4-27a387f2971d req-96da5a1b-5c8f-4120-bd77-798712927d03 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updated VIF entry in instance network info cache for port 1f078b11-852d-42c3-93f7-9ccacc104851. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.network.neutron [req-b0bf8ab2-1644-44a2-84d4-27a387f2971d req-96da5a1b-5c8f-4120-bd77-798712927d03 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updating instance_info_cache with network_info: [{"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b0bf8ab2-1644-44a2-84d4-27a387f2971d req-96da5a1b-5c8f-4120-bd77-798712927d03 service nova] Releasing lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:14 user nova-compute[75813]: INFO nova.compute.manager [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Terminating instance
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:16:14 user nova-compute[75813]: INFO nova.compute.claims [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Claim successful on node user
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-59bebdca-e486-4d59-8d84-48b38a364b0a req-b8ab7c49-34bc-47e9-903a-9f45d35ee4f3 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-unplugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-59bebdca-e486-4d59-8d84-48b38a364b0a req-b8ab7c49-34bc-47e9-903a-9f45d35ee4f3 service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-59bebdca-e486-4d59-8d84-48b38a364b0a req-b8ab7c49-34bc-47e9-903a-9f45d35ee4f3 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-59bebdca-e486-4d59-8d84-48b38a364b0a req-b8ab7c49-34bc-47e9-903a-9f45d35ee4f3 service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-59bebdca-e486-4d59-8d84-48b38a364b0a req-b8ab7c49-34bc-47e9-903a-9f45d35ee4f3 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-unplugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-59bebdca-e486-4d59-8d84-48b38a364b0a req-b8ab7c49-34bc-47e9-903a-9f45d35ee4f3 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-unplugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:14 user nova-compute[75813]: INFO nova.compute.manager [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Detaching volume ae4f4a31-d390-4907-a0f0-7f919dc9d105
Nov 15 13:16:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:14 user nova-compute[75813]: INFO nova.virt.block_device [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Attempting to driver detach volume ae4f4a31-d390-4907-a0f0-7f919dc9d105 from mountpoint /dev/vdb
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Attempting to detach device vdb from instance 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:16:14 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:16:14 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 13:16:14 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:16:14 user nova-compute[75813]:   <serial>ae4f4a31-d390-4907-a0f0-7f919dc9d105</serial>
Nov 15 13:16:14 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 13:16:14 user nova-compute[75813]: </disk>
Nov 15 13:16:14 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:16:14 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Successfully detached device vdb from instance 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf from the persistent domain config.
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:16:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:16:14 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:16:14 user nova-compute[75813]:   <source dev="/dev/sdd"/>
Nov 15 13:16:14 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:16:14 user nova-compute[75813]:   <serial>ae4f4a31-d390-4907-a0f0-7f919dc9d105</serial>
Nov 15 13:16:14 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 13:16:14 user nova-compute[75813]: </disk>
Nov 15 13:16:14 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:16:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.policy [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '754cbdd42e894349bdacf3a0c7ba06cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71da470a3bdb4093bc2b5db0b66fa08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:16:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Creating image(s)
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "/opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:16:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Instance destroyed successfully.
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.objects.instance [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'resources' on Instance uuid 4ae1ec46-9edc-477d-a9c1-2455a76bda4e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1912171362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1912171362',id=27,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:02:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-6ig6c18m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:04:14Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=4ae1ec46-9edc-477d-a9c1-2455a76bda4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "address": "fa:16:3e:a4:51:7a", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ebe3e1-c2", "ovs_interfaceid": "c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:51:7a,bridge_name='br-int',has_traffic_filtering=True,id=c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ebe3e1-c2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_vif [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:51:7a,bridge_name='br-int',has_traffic_filtering=True,id=c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ebe3e1-c2') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8ebe3e1-c2, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fef94d04-cd9c-4e88-a620-645d03f5bb55) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:16:15 user nova-compute[75813]: INFO os_vif [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:51:7a,bridge_name='br-int',has_traffic_filtering=True,id=c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ebe3e1-c2')
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDQuPdsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:16:15 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b1a1ec-68fa-45aa-98ca-ba9b26049e0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:16:15 user nova-compute[75813]: No targets found.
Nov 15 13:16:15 user nova-compute[75813]: iSNS:
Nov 15 13:16:15 user nova-compute[75813]: No targets found.
Nov 15 13:16:15 user nova-compute[75813]: STATIC:
Nov 15 13:16:15 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105
Nov 15 13:16:15 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:16:15 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:16:15 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7
Nov 15 13:16:15 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:16:15 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:16:15 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db
Nov 15 13:16:15 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:16:15 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:16:15 user nova-compute[75813]: FIRMWARE:
Nov 15 13:16:15 user nova-compute[75813]: No targets found.
Nov 15 13:16:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:16:15 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:16:15 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b4e42e-93cd-4be4-b2dd-92c504d00223]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f094a8a5-9559-4274-8863-48bf6929a218]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:16:15 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:16:15 user nova-compute[75813]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:16:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db (non-flash)
Nov 15 13:16:15 user nova-compute[75813]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:16:15 user nova-compute[75813]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:16:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55504727a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db'): ({'sdc'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Removing single pathed devices sdc {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.079s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[785a327e-0624-443e-9ef3-6a5e5c5a7490]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75c1e32-6139-487b-9bbf-dddf72d6d7f4]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Flushing IO for device /dev/sdc {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-71113104-dff5-4e45-85c9-5a083970e65b req-cb683acf-05df-4740-8656-f548ee766b41 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-changed-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-71113104-dff5-4e45-85c9-5a083970e65b req-cb683acf-05df-4740-8656-f548ee766b41 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Refreshing instance network info cache due to event network-changed-1f078b11-852d-42c3-93f7-9ccacc104851. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-71113104-dff5-4e45-85c9-5a083970e65b req-cb683acf-05df-4740-8656-f548ee766b41 service nova] Acquiring lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-71113104-dff5-4e45-85c9-5a083970e65b req-cb683acf-05df-4740-8656-f548ee766b41 service nova] Acquired lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.network.neutron [req-71113104-dff5-4e45-85c9-5a083970e65b req-cb683acf-05df-4740-8656-f548ee766b41 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Refreshing network info cache for port 1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a42470b-40e2-4c03-98f0-e326a99dd45f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk 1073741824" returned: 0 in 0.071s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d24182-6ae6-4c0c-8d72-c3a271089b1a]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee89001-4f7d-4416-be83-76247600a2f3]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabefbc3-6619-4316-ab08-edb217ee50b6]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db, portal: 172.16.0.220,3260]
Nov 15 13:16:15 user nova-compute[75813]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db, portal: 172.16.0.220,3260] successful.
Nov 15 13:16:15 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Successfully created port: 6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2276ac3-49cf-4b64-9579-43dac4a7f7db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7699e93e-f9f3-4d09-a0b2-1cf493437b92]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] <== disconnect_volume: return (461ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:16:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Deleting instance files /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e_del
Nov 15 13:16:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Deletion of /opt/stack/data/nova/instances/4ae1ec46-9edc-477d-a9c1-2455a76bda4e_del complete
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.193s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:16:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:16 user nova-compute[75813]: INFO nova.compute.manager [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Took 1.65 seconds to destroy the instance on the hypervisor.
Nov 15 13:16:16 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Cannot resize image /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Ensure instance console log exists: /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG nova.network.neutron [req-71113104-dff5-4e45-85c9-5a083970e65b req-cb683acf-05df-4740-8656-f548ee766b41 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updated VIF entry in instance network info cache for port 1f078b11-852d-42c3-93f7-9ccacc104851. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG nova.network.neutron [req-71113104-dff5-4e45-85c9-5a083970e65b req-cb683acf-05df-4740-8656-f548ee766b41 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updating instance_info_cache with network_info: [{"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-71113104-dff5-4e45-85c9-5a083970e65b req-cb683acf-05df-4740-8656-f548ee766b41 service nova] Releasing lock "refresh_cache-1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-8aed3010-e518-42ae-b536-95e18ff24443 req-dad5be08-b6e2-41b5-a29b-0f2061f79a2f service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8aed3010-e518-42ae-b536-95e18ff24443 req-dad5be08-b6e2-41b5-a29b-0f2061f79a2f service nova] Acquiring lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8aed3010-e518-42ae-b536-95e18ff24443 req-dad5be08-b6e2-41b5-a29b-0f2061f79a2f service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8aed3010-e518-42ae-b536-95e18ff24443 req-dad5be08-b6e2-41b5-a29b-0f2061f79a2f service nova] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-8aed3010-e518-42ae-b536-95e18ff24443 req-dad5be08-b6e2-41b5-a29b-0f2061f79a2f service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] No waiting events found dispatching network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:16:16 user nova-compute[75813]: WARNING nova.compute.manager [req-8aed3010-e518-42ae-b536-95e18ff24443 req-dad5be08-b6e2-41b5-a29b-0f2061f79a2f service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received unexpected event network-vif-plugged-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 for instance with vm_state active and task_state deleting.
Nov 15 13:16:16 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:16:16 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Took 0.85 seconds to deallocate network for instance.
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Successfully updated port: 6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquired lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updating instance_info_cache with network_info: [{"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Releasing lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Instance network_info: |[{"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Start _get_guest_xml network_info=[{"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:16:17 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:16:17 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-641669488',display_name='tempest-ServerRescueNegativeTestJSON-server-641669488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-641669488',id=44,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlylzbWO8l7Mulp5btslf0xF6sHF5XDSRD62oeDaTad9apG2CbMDrSjILb7W39BYYIjc+s0JZzh4+4huOUsOKMl8g6/VlGYg4vOb3fJ1SX1SfNIK0YKAeymlNj/oiAVpA==',key_name='tempest-keypair-2136231595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-9l00sjy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=51af821e-6a11-406e-95f6-0cd4501a6c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:91:72,bridge_name='br-int',has_traffic_filtering=True,id=6b13cb80-a670-4df8-9d5a-56c84170e3c2,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13cb80-a6') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.objects.instance [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'pci_devices' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:16:17 user nova-compute[75813]:   <uuid>51af821e-6a11-406e-95f6-0cd4501a6c33</uuid>
Nov 15 13:16:17 user nova-compute[75813]:   <name>instance-0000002c</name>
Nov 15 13:16:17 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:16:17 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:16:17 user nova-compute[75813]:   <metadata>
Nov 15 13:16:17 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:16:17 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:16:17 user nova-compute[75813]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-641669488</nova:name>
Nov 15 13:16:17 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:16:17</nova:creationTime>
Nov 15 13:16:17 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:16:17 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:16:17 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:16:17 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:16:17 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:16:17 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:16:17 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:16:17 user nova-compute[75813]:       <nova:owner>
Nov 15 13:16:17 user nova-compute[75813]:         <nova:user uuid="754cbdd42e894349bdacf3a0c7ba06cc">tempest-ServerRescueNegativeTestJSON-1475327670-project-member</nova:user>
Nov 15 13:16:17 user nova-compute[75813]:         <nova:project uuid="71da470a3bdb4093bc2b5db0b66fa08e">tempest-ServerRescueNegativeTestJSON-1475327670</nova:project>
Nov 15 13:16:17 user nova-compute[75813]:       </nova:owner>
Nov 15 13:16:17 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:16:17 user nova-compute[75813]:       <nova:ports>
Nov 15 13:16:17 user nova-compute[75813]:         <nova:port uuid="6b13cb80-a670-4df8-9d5a-56c84170e3c2">
Nov 15 13:16:17 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 13:16:17 user nova-compute[75813]:         </nova:port>
Nov 15 13:16:17 user nova-compute[75813]:       </nova:ports>
Nov 15 13:16:17 user nova-compute[75813]:     </nova:instance>
Nov 15 13:16:17 user nova-compute[75813]:   </metadata>
Nov 15 13:16:17 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:16:17 user nova-compute[75813]:     <system>
Nov 15 13:16:17 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:16:17 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:16:17 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:16:17 user nova-compute[75813]:       <entry name="serial">51af821e-6a11-406e-95f6-0cd4501a6c33</entry>
Nov 15 13:16:17 user nova-compute[75813]:       <entry name="uuid">51af821e-6a11-406e-95f6-0cd4501a6c33</entry>
Nov 15 13:16:17 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:16:17 user nova-compute[75813]:     </system>
Nov 15 13:16:17 user nova-compute[75813]:   </sysinfo>
Nov 15 13:16:17 user nova-compute[75813]:   <os>
Nov 15 13:16:17 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:16:17 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:16:17 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:16:17 user nova-compute[75813]:   </os>
Nov 15 13:16:17 user nova-compute[75813]:   <features>
Nov 15 13:16:17 user nova-compute[75813]:     <acpi/>
Nov 15 13:16:17 user nova-compute[75813]:     <apic/>
Nov 15 13:16:17 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:16:17 user nova-compute[75813]:   </features>
Nov 15 13:16:17 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:16:17 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:16:17 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:16:17 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:16:17 user nova-compute[75813]:   </clock>
Nov 15 13:16:17 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:16:17 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:16:17 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:16:17 user nova-compute[75813]:   </cpu>
Nov 15 13:16:17 user nova-compute[75813]:   <devices>
Nov 15 13:16:17 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:16:17 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:16:17 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk"/>
Nov 15 13:16:17 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:16:17 user nova-compute[75813]:     </disk>
Nov 15 13:16:17 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:16:17 user nova-compute[75813]:       <mac address="fa:16:3e:f0:91:72"/>
Nov 15 13:16:17 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:16:17 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:16:17 user nova-compute[75813]:       <target dev="tap6b13cb80-a6"/>
Nov 15 13:16:17 user nova-compute[75813]:     </interface>
Nov 15 13:16:17 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:16:17 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/console.log" append="off"/>
Nov 15 13:16:17 user nova-compute[75813]:     </serial>
Nov 15 13:16:17 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:16:17 user nova-compute[75813]:     <video>
Nov 15 13:16:17 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:16:17 user nova-compute[75813]:     </video>
Nov 15 13:16:17 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:16:17 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:16:17 user nova-compute[75813]:     </rng>
Nov 15 13:16:17 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:16:17 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:16:17 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:16:17 user nova-compute[75813]:     </memballoon>
Nov 15 13:16:17 user nova-compute[75813]:   </devices>
Nov 15 13:16:17 user nova-compute[75813]: </domain>
Nov 15 13:16:17 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-641669488',display_name='tempest-ServerRescueNegativeTestJSON-server-641669488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-641669488',id=44,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlylzbWO8l7Mulp5btslf0xF6sHF5XDSRD62oeDaTad9apG2CbMDrSjILb7W39BYYIjc+s0JZzh4+4huOUsOKMl8g6/VlGYg4vOb3fJ1SX1SfNIK0YKAeymlNj/oiAVpA==',key_name='tempest-keypair-2136231595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-9l00sjy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=51af821e-6a11-406e-95f6-0cd4501a6c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:91:72,bridge_name='br-int',has_traffic_filtering=True,id=6b13cb80-a670-4df8-9d5a-56c84170e3c2,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13cb80-a6') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG os_vif [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:91:72,bridge_name='br-int',has_traffic_filtering=True,id=6b13cb80-a670-4df8-9d5a-56c84170e3c2,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13cb80-a6') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56557d12-7745-58c5-a8d2-478c81f4ab4d', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b13cb80-a6, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b13cb80-a6, col_values=(('qos', UUID('b683f519-a6cc-4ac6-85ee-e582211be42a')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b13cb80-a6, col_values=(('external_ids', {'iface-id': '6b13cb80-a670-4df8-9d5a-56c84170e3c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:91:72', 'vm-uuid': '51af821e-6a11-406e-95f6-0cd4501a6c33'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:17 user nova-compute[75813]: INFO os_vif [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:91:72,bridge_name='br-int',has_traffic_filtering=True,id=6b13cb80-a670-4df8-9d5a-56c84170e3c2,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13cb80-a6')
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No VIF found with MAC fa:16:3e:f0:91:72, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:16:17 user nova-compute[75813]: INFO nova.compute.manager [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 13:16:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:16:17 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:16:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:18 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Deleted allocations for instance 4ae1ec46-9edc-477d-a9c1-2455a76bda4e
Nov 15 13:16:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bdd88bff-7f7e-4faf-94c0-2b740418b74e tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "4ae1ec46-9edc-477d-a9c1-2455a76bda4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.749s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-58881131-eaf0-4c77-93aa-99f8e81cf95f req-87fa74e8-a41c-4205-94d4-a26789a90199 service nova] [instance: 4ae1ec46-9edc-477d-a9c1-2455a76bda4e] Received event network-vif-deleted-c8ebe3e1-c2a4-4185-a0b9-0621de5afcb9 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-58881131-eaf0-4c77-93aa-99f8e81cf95f req-87fa74e8-a41c-4205-94d4-a26789a90199 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-changed-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:18 user nova-compute[75813]: DEBUG nova.compute.manager [req-58881131-eaf0-4c77-93aa-99f8e81cf95f req-87fa74e8-a41c-4205-94d4-a26789a90199 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Refreshing instance network info cache due to event network-changed-6b13cb80-a670-4df8-9d5a-56c84170e3c2. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:16:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-58881131-eaf0-4c77-93aa-99f8e81cf95f req-87fa74e8-a41c-4205-94d4-a26789a90199 service nova] Acquiring lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:16:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-58881131-eaf0-4c77-93aa-99f8e81cf95f req-87fa74e8-a41c-4205-94d4-a26789a90199 service nova] Acquired lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:16:18 user nova-compute[75813]: DEBUG nova.network.neutron [req-58881131-eaf0-4c77-93aa-99f8e81cf95f req-87fa74e8-a41c-4205-94d4-a26789a90199 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Refreshing network info cache for port 6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:16:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-d0ff5ec9-8801-4fcd-bcfa-76884c3466fc req-e3ef56ba-7d52-403a-b69d-e3c51bf638f0 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d0ff5ec9-8801-4fcd-bcfa-76884c3466fc req-e3ef56ba-7d52-403a-b69d-e3c51bf638f0 service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d0ff5ec9-8801-4fcd-bcfa-76884c3466fc req-e3ef56ba-7d52-403a-b69d-e3c51bf638f0 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d0ff5ec9-8801-4fcd-bcfa-76884c3466fc req-e3ef56ba-7d52-403a-b69d-e3c51bf638f0 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-d0ff5ec9-8801-4fcd-bcfa-76884c3466fc req-e3ef56ba-7d52-403a-b69d-e3c51bf638f0 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:16:19 user nova-compute[75813]: WARNING nova.compute.manager [req-d0ff5ec9-8801-4fcd-bcfa-76884c3466fc req-e3ef56ba-7d52-403a-b69d-e3c51bf638f0 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state building and task_state spawning.
Nov 15 13:16:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:19 user nova-compute[75813]: DEBUG nova.network.neutron [req-58881131-eaf0-4c77-93aa-99f8e81cf95f req-87fa74e8-a41c-4205-94d4-a26789a90199 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updated VIF entry in instance network info cache for port 6b13cb80-a670-4df8-9d5a-56c84170e3c2. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:16:19 user nova-compute[75813]: DEBUG nova.network.neutron [req-58881131-eaf0-4c77-93aa-99f8e81cf95f req-87fa74e8-a41c-4205-94d4-a26789a90199 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updating instance_info_cache with network_info: [{"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:16:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-58881131-eaf0-4c77-93aa-99f8e81cf95f req-87fa74e8-a41c-4205-94d4-a26789a90199 service nova] Releasing lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:16:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:16:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Instance spawned successfully.
Nov 15 13:16:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-b00f374b-486e-411d-94c8-40b109752323 req-240e8793-4a78-460e-a1a1-a1c60ea49d48 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b00f374b-486e-411d-94c8-40b109752323 req-240e8793-4a78-460e-a1a1-a1c60ea49d48 service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b00f374b-486e-411d-94c8-40b109752323 req-240e8793-4a78-460e-a1a1-a1c60ea49d48 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b00f374b-486e-411d-94c8-40b109752323 req-240e8793-4a78-460e-a1a1-a1c60ea49d48 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-b00f374b-486e-411d-94c8-40b109752323 req-240e8793-4a78-460e-a1a1-a1c60ea49d48 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:16:21 user nova-compute[75813]: WARNING nova.compute.manager [req-b00f374b-486e-411d-94c8-40b109752323 req-240e8793-4a78-460e-a1a1-a1c60ea49d48 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state building and task_state spawning.
Nov 15 13:16:21 user nova-compute[75813]: INFO nova.compute.manager [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 15 13:16:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:16:21 user nova-compute[75813]: INFO nova.compute.manager [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Took 6.56 seconds to build instance.
Nov 15 13:16:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2337af97-76d9-41fb-95e0-1ad54353acbe tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.661s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:16:35 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf is timed out.
Nov 15 13:16:35 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Successfully detached device vdb from instance 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf from the live domain config.
Nov 15 13:16:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZGYbtMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:16:35 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[19419066-94e1-43c7-84f7-0f0a4bde5799]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:16:35 user nova-compute[75813]: No targets found.
Nov 15 13:16:35 user nova-compute[75813]: iSNS:
Nov 15 13:16:35 user nova-compute[75813]: No targets found.
Nov 15 13:16:35 user nova-compute[75813]: STATIC:
Nov 15 13:16:35 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105
Nov 15 13:16:35 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:16:35 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:16:35 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7
Nov 15 13:16:35 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:16:35 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:16:35 user nova-compute[75813]: FIRMWARE:
Nov 15 13:16:35 user nova-compute[75813]: No targets found.
Nov 15 13:16:35 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:16:35 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:16:35 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc010c60-4fbd-4acc-aa36-ac569d52d161]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4630418b-e93d-4fb4-b909-e3ac8001a659]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:16:35 user nova-compute[75813]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:16:35 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 (non-flash)
Nov 15 13:16:35 user nova-compute[75813]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:16:35 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55501c4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105'): ({'sdd'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Removing single pathed devices sdd {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dd96b3-51ee-40ac-a435-52da2f242bed]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd140641-e0a7-4ad9-b59f-7c66ffe4dffb]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Flushing IO for device /dev/sdd {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fe904a-e683-4845-b810-0b8e62e18b09]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5282078-6d7b-4337-9c2c-4d9e4db5b608]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] SCSI volumes sdd have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce21c144-ec5d-4ac5-a7d9-a2489ede7843]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[14afcc51-736a-447d-bb70-a19a07135744]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260]
Nov 15 13:16:35 user nova-compute[75813]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105, portal: 172.16.0.220,3260] successful.
Nov 15 13:16:35 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4f4a31-d390-4907-a0f0-7f919dc9d105 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d61b58-d610-4c3b-97a9-d43f82d57195]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] <== disconnect_volume: return (320ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:16:35 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:16:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:36 user nova-compute[75813]: DEBUG nova.objects.instance [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'flavor' on Instance uuid 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:16:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-65fc6f6a-15a6-4a56-9028-a980e8f33647 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.129s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:47 user nova-compute[75813]: INFO nova.compute.manager [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Terminating instance
Nov 15 13:16:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-46ee1ac6-00a3-440f-8d88-3ae816a5a79b req-0a51e727-2438-487e-87bb-d7b824ff2447 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received event network-vif-unplugged-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-46ee1ac6-00a3-440f-8d88-3ae816a5a79b req-0a51e727-2438-487e-87bb-d7b824ff2447 service nova] Acquiring lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-46ee1ac6-00a3-440f-8d88-3ae816a5a79b req-0a51e727-2438-487e-87bb-d7b824ff2447 service nova] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-46ee1ac6-00a3-440f-8d88-3ae816a5a79b req-0a51e727-2438-487e-87bb-d7b824ff2447 service nova] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-46ee1ac6-00a3-440f-8d88-3ae816a5a79b req-0a51e727-2438-487e-87bb-d7b824ff2447 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] No waiting events found dispatching network-vif-unplugged-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-46ee1ac6-00a3-440f-8d88-3ae816a5a79b req-0a51e727-2438-487e-87bb-d7b824ff2447 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received event network-vif-unplugged-47f90629-6062-435c-82c7-44fb6630327c for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Instance destroyed successfully.
Nov 15 13:16:47 user nova-compute[75813]: DEBUG nova.objects.instance [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lazy-loading 'resources' on Instance uuid 2153a37a-4973-4008-b20c-1bd03dbc39c1 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1103046064',display_name='tempest-ServerActionsTestOtherA-server-1103046064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1103046064',id=24,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVScCZLXI8rlN2zoy2tMpAv6grzq+Q7BUD3jx/c9Ws+QNGWvOGcy9SrrC2M21ruqsJkGVx6GSsSkIbkFK6Q0lAtOU+eEFXMzxHts/+TJKb69Xyco0mKWaJkDc6A3DpPzg==',key_name='tempest-keypair-21661059',keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:58:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76ae639fa3444ba0be3d480b8572a0e6',ramdisk_id='',reservation_id='r-3m4iu18e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1826218173',owner_user_name='tempest-ServerActionsTestOtherA-1826218173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:58:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2b3f74a69954ecf8d5cce188f5fc043',uuid=2153a37a-4973-4008-b20c-1bd03dbc39c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converting VIF {"id": "47f90629-6062-435c-82c7-44fb6630327c", "address": "fa:16:3e:9d:6a:6f", "network": {"id": "9068787a-2164-487a-874e-09a96fb75ec0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1744536350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ae639fa3444ba0be3d480b8572a0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47f90629-60", "ovs_interfaceid": "47f90629-6062-435c-82c7-44fb6630327c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:6a:6f,bridge_name='br-int',has_traffic_filtering=True,id=47f90629-6062-435c-82c7-44fb6630327c,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47f90629-60') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG os_vif [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:6a:6f,bridge_name='br-int',has_traffic_filtering=True,id=47f90629-6062-435c-82c7-44fb6630327c,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47f90629-60') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47f90629-60, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a1a984c-af4a-4466-8f53-fe02616d09dd) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:16:47 user nova-compute[75813]: INFO os_vif [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:6a:6f,bridge_name='br-int',has_traffic_filtering=True,id=47f90629-6062-435c-82c7-44fb6630327c,network=Network(9068787a-2164-487a-874e-09a96fb75ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47f90629-60')
Nov 15 13:16:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Deleting instance files /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1_del
Nov 15 13:16:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Deletion of /opt/stack/data/nova/instances/2153a37a-4973-4008-b20c-1bd03dbc39c1_del complete
Nov 15 13:16:48 user nova-compute[75813]: INFO nova.compute.manager [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 15 13:16:48 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:16:48 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:16:48 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:16:48 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:16:48 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Took 0.55 seconds to deallocate network for instance.
Nov 15 13:16:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:48 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:16:48 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:16:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:49 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Deleted allocations for instance 2153a37a-4973-4008-b20c-1bd03dbc39c1
Nov 15 13:16:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-35ae4dbc-a63c-4334-8250-1c56726a260c tempest-ServerActionsTestOtherA-1826218173 tempest-ServerActionsTestOtherA-1826218173-project-member] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.790s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-e35c77a7-e871-4fae-b1fc-d04b642eee61 req-f9e29005-52fc-469b-88e4-5bde4c5d6150 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received event network-vif-plugged-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e35c77a7-e871-4fae-b1fc-d04b642eee61 req-f9e29005-52fc-469b-88e4-5bde4c5d6150 service nova] Acquiring lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e35c77a7-e871-4fae-b1fc-d04b642eee61 req-f9e29005-52fc-469b-88e4-5bde4c5d6150 service nova] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e35c77a7-e871-4fae-b1fc-d04b642eee61 req-f9e29005-52fc-469b-88e4-5bde4c5d6150 service nova] Lock "2153a37a-4973-4008-b20c-1bd03dbc39c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-e35c77a7-e871-4fae-b1fc-d04b642eee61 req-f9e29005-52fc-469b-88e4-5bde4c5d6150 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] No waiting events found dispatching network-vif-plugged-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:16:49 user nova-compute[75813]: WARNING nova.compute.manager [req-e35c77a7-e871-4fae-b1fc-d04b642eee61 req-f9e29005-52fc-469b-88e4-5bde4c5d6150 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received unexpected event network-vif-plugged-47f90629-6062-435c-82c7-44fb6630327c for instance with vm_state deleted and task_state None.
Nov 15 13:16:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-e35c77a7-e871-4fae-b1fc-d04b642eee61 req-f9e29005-52fc-469b-88e4-5bde4c5d6150 service nova] [instance: 2153a37a-4973-4008-b20c-1bd03dbc39c1] Received event network-vif-deleted-47f90629-6062-435c-82c7-44fb6630327c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:53 user nova-compute[75813]: DEBUG nova.compute.manager [req-ff4e3eec-98c7-474a-bed2-1ebae5610bb4 req-1f6f5979-f2d5-4c79-93be-33f0d48d393b service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received event network-changed-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:16:53 user nova-compute[75813]: DEBUG nova.compute.manager [req-ff4e3eec-98c7-474a-bed2-1ebae5610bb4 req-1f6f5979-f2d5-4c79-93be-33f0d48d393b service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Refreshing instance network info cache due to event network-changed-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:16:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ff4e3eec-98c7-474a-bed2-1ebae5610bb4 req-1f6f5979-f2d5-4c79-93be-33f0d48d393b service nova] Acquiring lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:16:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ff4e3eec-98c7-474a-bed2-1ebae5610bb4 req-1f6f5979-f2d5-4c79-93be-33f0d48d393b service nova] Acquired lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:16:53 user nova-compute[75813]: DEBUG nova.network.neutron [req-ff4e3eec-98c7-474a-bed2-1ebae5610bb4 req-1f6f5979-f2d5-4c79-93be-33f0d48d393b service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Refreshing network info cache for port ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:16:54 user nova-compute[75813]: DEBUG nova.network.neutron [req-ff4e3eec-98c7-474a-bed2-1ebae5610bb4 req-1f6f5979-f2d5-4c79-93be-33f0d48d393b service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Updated VIF entry in instance network info cache for port ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:16:54 user nova-compute[75813]: DEBUG nova.network.neutron [req-ff4e3eec-98c7-474a-bed2-1ebae5610bb4 req-1f6f5979-f2d5-4c79-93be-33f0d48d393b service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Updating instance_info_cache with network_info: [{"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:16:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ff4e3eec-98c7-474a-bed2-1ebae5610bb4 req-1f6f5979-f2d5-4c79-93be-33f0d48d393b service nova] Releasing lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:16:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:16:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "191fa449-c6c6-4096-94bb-df2225ad1ce2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:58 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:16:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:16:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:16:58 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:16:58 user nova-compute[75813]: INFO nova.compute.claims [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Claim successful on node user
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:16:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:16:59 user nova-compute[75813]: INFO nova.virt.block_device [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Booting with volume fb45e05d-9b46-4752-8090-0ecddf826540 at /dev/vda
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.policy [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bc41f21cddc40e7a287b6f809233a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63086918b1c84a608c4a5aebf968eab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG os_brick.utils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64c5778-724c-46b8-828b-3a53bbed0166]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8057ae86-fb44-4ee9-bfd1-d0839ef99b76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b177ca0-c289-4cb8-84fe-67fb309c3f6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aed17f2-2ea8-4234-92f5-84a406378156]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Updating instance_info_cache with network_info: [{"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:16:59 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[30538749-d43e-462b-98ae-e2c07b3f1e4b]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG os_brick.utils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Updating existing volume attachment record: d2782d4b-6e22-4a13-8a18-82206c9879f7 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:16:59 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:17:00 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Successfully created port: aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:17:00 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Successfully updated port: aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:17:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:17:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquired lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:17:00 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-3de460dc-cef9-4338-8b5b-5f229e86433b req-7db3d101-ac24-4b36-bc0f-dafc9d53a2de service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received event network-changed-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-3de460dc-cef9-4338-8b5b-5f229e86433b req-7db3d101-ac24-4b36-bc0f-dafc9d53a2de service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Refreshing instance network info cache due to event network-changed-aecee797-fb71-4cc0-be57-f8f389ee13c2. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3de460dc-cef9-4338-8b5b-5f229e86433b req-7db3d101-ac24-4b36-bc0f-dafc9d53a2de service nova] Acquiring lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Updating instance_info_cache with network_info: [{"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Releasing lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Instance network_info: |[{"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3de460dc-cef9-4338-8b5b-5f229e86433b req-7db3d101-ac24-4b36-bc0f-dafc9d53a2de service nova] Acquired lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG nova.network.neutron [req-3de460dc-cef9-4338-8b5b-5f229e86433b req-7db3d101-ac24-4b36-bc0f-dafc9d53a2de service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Refreshing network info cache for port aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG nova.network.neutron [req-3de460dc-cef9-4338-8b5b-5f229e86433b req-7db3d101-ac24-4b36-bc0f-dafc9d53a2de service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Updated VIF entry in instance network info cache for port aecee797-fb71-4cc0-be57-f8f389ee13c2. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG nova.network.neutron [req-3de460dc-cef9-4338-8b5b-5f229e86433b req-7db3d101-ac24-4b36-bc0f-dafc9d53a2de service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Updating instance_info_cache with network_info: [{"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:17:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3de460dc-cef9-4338-8b5b-5f229e86433b req-7db3d101-ac24-4b36-bc0f-dafc9d53a2de service nova] Releasing lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:17:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:03 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:17:04 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Creating image(s)
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Did not create local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Ensure instance console log exists: /opt/stack/data/nova/instances/191fa449-c6c6-4096-94bb-df2225ad1ce2/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Start _get_guest_xml network_info=[{"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'attachment_id': 'd2782d4b-6e22-4a13-8a18-82206c9879f7', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHvIhoSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '191fa449-c6c6-4096-94bb-df2225ad1ce2', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb45e05d-9b46-4752-8090-0ecddf826540', 'serial': 'fb45e05d-9b46-4752-8090-0ecddf826540'}, 'volume_type': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:17:04 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:17:04 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHvIhoSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:17:04 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:17:04 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:17:04 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[263fc2c5-7715-40ef-be5c-008a97bc9462]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:17:04 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7c2230-ce17-46e1-9ee6-e0ea24a5f6d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540] added
Nov 15 13:17:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd9740-703c-43c5-8a56-3258362cc79a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ddd608-2a18-4784-a1bb-17a46e1a0ad2]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHvIhoSn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHvIhoSn" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca38a4b-0c22-44d2-aa43-da64239c2673]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pHvIhoSn'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[031aa7b4-1b31-4e63-999e-3af74038b7bd]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[85731f41-c18e-4c4a-ba53-a5c4a1657fea]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:17:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:17:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e83517-1a19-4582-9a72-2407972bded0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540, portal: 172.16.0.220,3260]
Nov 15 13:17:04 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540, portal: 172.16.0.220,3260] successful.
Nov 15 13:17:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8626160-cece-4265-9fcf-63ade04d64ab]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39b87ec-30a2-423a-a7ef-2e7352e71aeb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:17:04 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:17:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:17:04 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:17:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[415c31b3-2a58-49b8-9833-bc82c626deb5]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:17:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHvIhoSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:05 user nova-compute[75813]: INFO nova.compute.manager [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Terminating instance
Nov 15 13:17:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-604ecd34-ff1e-41e6-a670-8140e924b76c req-538ec5b6-0325-464d-afb7-311968dfb70d service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Received event network-vif-unplugged-cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-604ecd34-ff1e-41e6-a670-8140e924b76c req-538ec5b6-0325-464d-afb7-311968dfb70d service nova] Acquiring lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-604ecd34-ff1e-41e6-a670-8140e924b76c req-538ec5b6-0325-464d-afb7-311968dfb70d service nova] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-604ecd34-ff1e-41e6-a670-8140e924b76c req-538ec5b6-0325-464d-afb7-311968dfb70d service nova] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-604ecd34-ff1e-41e6-a670-8140e924b76c req-538ec5b6-0325-464d-afb7-311968dfb70d service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] No waiting events found dispatching network-vif-unplugged-cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-604ecd34-ff1e-41e6-a670-8140e924b76c req-538ec5b6-0325-464d-afb7-311968dfb70d service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Received event network-vif-unplugged-cea789d8-f924-42d5-be5b-e43e32d9d727 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:17:05 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Instance destroyed successfully.
Nov 15 13:17:05 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lazy-loading 'resources' on Instance uuid 70ddb35e-bc7c-4e18-8028-54496eef0cce {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T12:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1726108945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1726108945',id=23,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T12:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='134cc574095942efb38b85068bc72bfe',ramdisk_id='',reservation_id='r-oq8j2qd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T12:59:25Z,user_data=None,user_id='07f52b120c2e46e2a8ca7eb83dafceca',uuid=70ddb35e-bc7c-4e18-8028-54496eef0cce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converting VIF {"id": "cea789d8-f924-42d5-be5b-e43e32d9d727", "address": "fa:16:3e:3b:51:17", "network": {"id": "6b2cde01-8575-4027-9a22-80dee4aeb4ae", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1612604130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "134cc574095942efb38b85068bc72bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea789d8-f9", "ovs_interfaceid": "cea789d8-f924-42d5-be5b-e43e32d9d727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:51:17,bridge_name='br-int',has_traffic_filtering=True,id=cea789d8-f924-42d5-be5b-e43e32d9d727,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea789d8-f9') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG os_vif [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:51:17,bridge_name='br-int',has_traffic_filtering=True,id=cea789d8-f924-42d5-be5b-e43e32d9d727,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea789d8-f9') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23364653965363661', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364653965363661', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcea789d8-f9, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=509f3220-4701-46fc-bc59-e2ff736ce565) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:17:06 user nova-compute[75813]: INFO os_vif [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:51:17,bridge_name='br-int',has_traffic_filtering=True,id=cea789d8-f924-42d5-be5b-e43e32d9d727,network=Network(6b2cde01-8575-4027-9a22-80dee4aeb4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea789d8-f9')
Nov 15 13:17:06 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Deleting instance files /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce_del
Nov 15 13:17:06 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Deletion of /opt/stack/data/nova/instances/70ddb35e-bc7c-4e18-8028-54496eef0cce_del complete
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1593581397',display_name='tempest-TestVolumeBootPattern-server-1593581397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1593581397',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVAQWHIq9cYMEzcyVYcUoyfR2jxd2gljn//pF8UzTbmKwL/Z5WpRY76WGV9mAg+N+3PLplBlRmOaiMT+tOytqHtvyAtP7F/jIKyI5SH5XjxLhIhN8ZWLbU2OF0/srpA==',key_name='tempest-TestVolumeBootPattern-1181310603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-5wh4podh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:16:59Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=191fa449-c6c6-4096-94bb-df2225ad1ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:24:50,bridge_name='br-int',has_traffic_filtering=True,id=aecee797-fb71-4cc0-be57-f8f389ee13c2,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecee797-fb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.objects.instance [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'pci_devices' on Instance uuid 191fa449-c6c6-4096-94bb-df2225ad1ce2 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:17:06 user nova-compute[75813]:   <uuid>191fa449-c6c6-4096-94bb-df2225ad1ce2</uuid>
Nov 15 13:17:06 user nova-compute[75813]:   <name>instance-0000002d</name>
Nov 15 13:17:06 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:17:06 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:17:06 user nova-compute[75813]:   <metadata>
Nov 15 13:17:06 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:17:06 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:17:06 user nova-compute[75813]:       <nova:name>tempest-TestVolumeBootPattern-server-1593581397</nova:name>
Nov 15 13:17:06 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:17:04</nova:creationTime>
Nov 15 13:17:06 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:17:06 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:17:06 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:17:06 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:17:06 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:17:06 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:17:06 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:17:06 user nova-compute[75813]:       <nova:owner>
Nov 15 13:17:06 user nova-compute[75813]:         <nova:user uuid="3bc41f21cddc40e7a287b6f809233a65">tempest-TestVolumeBootPattern-678819035-project-member</nova:user>
Nov 15 13:17:06 user nova-compute[75813]:         <nova:project uuid="63086918b1c84a608c4a5aebf968eab5">tempest-TestVolumeBootPattern-678819035</nova:project>
Nov 15 13:17:06 user nova-compute[75813]:       </nova:owner>
Nov 15 13:17:06 user nova-compute[75813]:       <nova:ports>
Nov 15 13:17:06 user nova-compute[75813]:         <nova:port uuid="aecee797-fb71-4cc0-be57-f8f389ee13c2">
Nov 15 13:17:06 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 13:17:06 user nova-compute[75813]:         </nova:port>
Nov 15 13:17:06 user nova-compute[75813]:       </nova:ports>
Nov 15 13:17:06 user nova-compute[75813]:     </nova:instance>
Nov 15 13:17:06 user nova-compute[75813]:   </metadata>
Nov 15 13:17:06 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:17:06 user nova-compute[75813]:     <system>
Nov 15 13:17:06 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:17:06 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:17:06 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:17:06 user nova-compute[75813]:       <entry name="serial">191fa449-c6c6-4096-94bb-df2225ad1ce2</entry>
Nov 15 13:17:06 user nova-compute[75813]:       <entry name="uuid">191fa449-c6c6-4096-94bb-df2225ad1ce2</entry>
Nov 15 13:17:06 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:17:06 user nova-compute[75813]:     </system>
Nov 15 13:17:06 user nova-compute[75813]:   </sysinfo>
Nov 15 13:17:06 user nova-compute[75813]:   <os>
Nov 15 13:17:06 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:17:06 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:17:06 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:17:06 user nova-compute[75813]:   </os>
Nov 15 13:17:06 user nova-compute[75813]:   <features>
Nov 15 13:17:06 user nova-compute[75813]:     <acpi/>
Nov 15 13:17:06 user nova-compute[75813]:     <apic/>
Nov 15 13:17:06 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:17:06 user nova-compute[75813]:   </features>
Nov 15 13:17:06 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:17:06 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:17:06 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:17:06 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:17:06 user nova-compute[75813]:   </clock>
Nov 15 13:17:06 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:17:06 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:17:06 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:17:06 user nova-compute[75813]:   </cpu>
Nov 15 13:17:06 user nova-compute[75813]:   <devices>
Nov 15 13:17:06 user nova-compute[75813]:     <disk type="block" device="disk">
Nov 15 13:17:06 user nova-compute[75813]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:17:06 user nova-compute[75813]:       <source dev="/dev/sdb"/>
Nov 15 13:17:06 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:17:06 user nova-compute[75813]:       <serial>fb45e05d-9b46-4752-8090-0ecddf826540</serial>
Nov 15 13:17:06 user nova-compute[75813]:     </disk>
Nov 15 13:17:06 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:17:06 user nova-compute[75813]:       <mac address="fa:16:3e:b4:24:50"/>
Nov 15 13:17:06 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:17:06 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:17:06 user nova-compute[75813]:       <target dev="tapaecee797-fb"/>
Nov 15 13:17:06 user nova-compute[75813]:     </interface>
Nov 15 13:17:06 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:17:06 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/191fa449-c6c6-4096-94bb-df2225ad1ce2/console.log" append="off"/>
Nov 15 13:17:06 user nova-compute[75813]:     </serial>
Nov 15 13:17:06 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:17:06 user nova-compute[75813]:     <video>
Nov 15 13:17:06 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:17:06 user nova-compute[75813]:     </video>
Nov 15 13:17:06 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:17:06 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:17:06 user nova-compute[75813]:     </rng>
Nov 15 13:17:06 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:17:06 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:17:06 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:17:06 user nova-compute[75813]:     </memballoon>
Nov 15 13:17:06 user nova-compute[75813]:   </devices>
Nov 15 13:17:06 user nova-compute[75813]: </domain>
Nov 15 13:17:06 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1593581397',display_name='tempest-TestVolumeBootPattern-server-1593581397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1593581397',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVAQWHIq9cYMEzcyVYcUoyfR2jxd2gljn//pF8UzTbmKwL/Z5WpRY76WGV9mAg+N+3PLplBlRmOaiMT+tOytqHtvyAtP7F/jIKyI5SH5XjxLhIhN8ZWLbU2OF0/srpA==',key_name='tempest-TestVolumeBootPattern-1181310603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-5wh4podh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:16:59Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=191fa449-c6c6-4096-94bb-df2225ad1ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:24:50,bridge_name='br-int',has_traffic_filtering=True,id=aecee797-fb71-4cc0-be57-f8f389ee13c2,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecee797-fb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG os_vif [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:24:50,bridge_name='br-int',has_traffic_filtering=True,id=aecee797-fb71-4cc0-be57-f8f389ee13c2,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecee797-fb') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '933e0e55-b271-57f0-b3a1-ed2b35822509', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaecee797-fb, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaecee797-fb, col_values=(('qos', UUID('a13c4fe7-b475-48a7-8a15-27a0a236297b')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaecee797-fb, col_values=(('external_ids', {'iface-id': 'aecee797-fb71-4cc0-be57-f8f389ee13c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:24:50', 'vm-uuid': '191fa449-c6c6-4096-94bb-df2225ad1ce2'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:17:06 user nova-compute[75813]: INFO os_vif [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:24:50,bridge_name='br-int',has_traffic_filtering=True,id=aecee797-fb71-4cc0-be57-f8f389ee13c2,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecee797-fb')
Nov 15 13:17:06 user nova-compute[75813]: INFO nova.compute.manager [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 13:17:06 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] No VIF found with MAC fa:16:3e:b4:24:50, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:17:06 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Took 0.46 seconds to deallocate network for instance.
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.compute.manager [req-ee5d8578-edb7-4f86-b5ed-3287a3c056e2 req-a0770fa9-6121-4090-9694-a2048dccab7f service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Received event network-vif-deleted-cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:17:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:06 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Deleted allocations for instance 70ddb35e-bc7c-4e18-8028-54496eef0cce
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c288c667-9813-4c2a-925f-bee11b06b5ca tempest-ServerBootFromVolumeStableRescueTest-2006280819 tempest-ServerBootFromVolumeStableRescueTest-2006280819-project-member] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.848s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:07 user nova-compute[75813]: INFO nova.compute.manager [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Terminating instance
Nov 15 13:17:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-dc1d6768-6053-4a57-a11b-52e7e7f258df req-377de554-3aee-49f6-bb07-e103466c9b09 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received event network-vif-plugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dc1d6768-6053-4a57-a11b-52e7e7f258df req-377de554-3aee-49f6-bb07-e103466c9b09 service nova] Acquiring lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dc1d6768-6053-4a57-a11b-52e7e7f258df req-377de554-3aee-49f6-bb07-e103466c9b09 service nova] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dc1d6768-6053-4a57-a11b-52e7e7f258df req-377de554-3aee-49f6-bb07-e103466c9b09 service nova] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-dc1d6768-6053-4a57-a11b-52e7e7f258df req-377de554-3aee-49f6-bb07-e103466c9b09 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] No waiting events found dispatching network-vif-plugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:17:07 user nova-compute[75813]: WARNING nova.compute.manager [req-dc1d6768-6053-4a57-a11b-52e7e7f258df req-377de554-3aee-49f6-bb07-e103466c9b09 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received unexpected event network-vif-plugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 for instance with vm_state building and task_state spawning.
Nov 15 13:17:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-5aed7cd9-e180-4cb6-bb07-2025269ac1c5 req-5487a33c-b81a-408d-997f-177e79dcb888 service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Received event network-vif-plugged-cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5aed7cd9-e180-4cb6-bb07-2025269ac1c5 req-5487a33c-b81a-408d-997f-177e79dcb888 service nova] Acquiring lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5aed7cd9-e180-4cb6-bb07-2025269ac1c5 req-5487a33c-b81a-408d-997f-177e79dcb888 service nova] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5aed7cd9-e180-4cb6-bb07-2025269ac1c5 req-5487a33c-b81a-408d-997f-177e79dcb888 service nova] Lock "70ddb35e-bc7c-4e18-8028-54496eef0cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG nova.compute.manager [req-5aed7cd9-e180-4cb6-bb07-2025269ac1c5 req-5487a33c-b81a-408d-997f-177e79dcb888 service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] No waiting events found dispatching network-vif-plugged-cea789d8-f924-42d5-be5b-e43e32d9d727 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:17:07 user nova-compute[75813]: WARNING nova.compute.manager [req-5aed7cd9-e180-4cb6-bb07-2025269ac1c5 req-5487a33c-b81a-408d-997f-177e79dcb888 service nova] [instance: 70ddb35e-bc7c-4e18-8028-54496eef0cce] Received unexpected event network-vif-plugged-cea789d8-f924-42d5-be5b-e43e32d9d727 for instance with vm_state deleted and task_state None.
Nov 15 13:17:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:08 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Instance destroyed successfully.
Nov 15 13:17:08 user nova-compute[75813]: DEBUG nova.objects.instance [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'resources' on Instance uuid 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2049584342',display_name='tempest-TestMinimumBasicScenario-server-2049584342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2049584342',id=39,image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa5tjbIEXhETwBangxK8fm82xWdlgvkGh0IwuZr+qf/5VH2hvHWFWMKycuaEXAFhAO+nW6Cesgaj6aMDOYdmbSgXWm4W3KyrShhiUTmG9ZUaj24Gkb/9DIRJ5FiFluMaA==',key_name='tempest-TestMinimumBasicScenario-1466995340',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:12:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5875a3450c054f9490f65fa0a603e699',ramdisk_id='',reservation_id='r-f5yh83em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea6ccd27-ceff-49b5-b0b7-7e9366dc0dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-651110609',owner_user_name='tempest-TestMinimumBasicScenario-651110609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:14:30Z,user_data=None,user_id='ea5ceaf286514f268b169a27bbfd4006',uuid=1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converting VIF {"id": "1f078b11-852d-42c3-93f7-9ccacc104851", "address": "fa:16:3e:c7:07:30", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f078b11-85", "ovs_interfaceid": "1f078b11-852d-42c3-93f7-9ccacc104851", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG os_vif [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f078b11-85, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a018a42c-e771-4f05-9b76-d870d493bef9) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:08 user nova-compute[75813]: INFO os_vif [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:07:30,bridge_name='br-int',has_traffic_filtering=True,id=1f078b11-852d-42c3-93f7-9ccacc104851,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f078b11-85')
Nov 15 13:17:08 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Deleting instance files /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf_del
Nov 15 13:17:08 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Deletion of /opt/stack/data/nova/instances/1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf_del complete
Nov 15 13:17:08 user nova-compute[75813]: INFO nova.compute.manager [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 13:17:08 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:17:08 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:17:08 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Took 0.69 seconds to deallocate network for instance.
Nov 15 13:17:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-a1faf943-7868-4c80-9dd3-2cf4c7483ac8 req-3742d83b-6c53-45d2-8045-b47f6a9c7d73 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-vif-deleted-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:09 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Deleted allocations for instance 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e14a4cd4-5b60-4489-bd35-ef16de730e48 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.033s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:17:09 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Instance spawned successfully.
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:17:09 user nova-compute[75813]: INFO nova.compute.manager [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received event network-vif-plugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] Acquiring lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] No waiting events found dispatching network-vif-plugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:17:09 user nova-compute[75813]: WARNING nova.compute.manager [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received unexpected event network-vif-plugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 for instance with vm_state building and task_state spawning.
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-vif-unplugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] No waiting events found dispatching network-vif-unplugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:17:09 user nova-compute[75813]: WARNING nova.compute.manager [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received unexpected event network-vif-unplugged-1f078b11-852d-42c3-93f7-9ccacc104851 for instance with vm_state deleted and task_state None.
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] Acquiring lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] Lock "1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] No waiting events found dispatching network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:17:09 user nova-compute[75813]: WARNING nova.compute.manager [req-74a9e8a4-3228-45f5-b878-fc735a5c2fcd req-c43e09cb-7a71-4521-ae2e-378b479921d1 service nova] [instance: 1f1ae9b4-fab3-4f3f-9f67-617a311c0cbf] Received unexpected event network-vif-plugged-1f078b11-852d-42c3-93f7-9ccacc104851 for instance with vm_state deleted and task_state None.
Nov 15 13:17:09 user nova-compute[75813]: INFO nova.compute.manager [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Took 10.75 seconds to build instance.
Nov 15 13:17:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8b4eba9e-f25d-4d5c-9735-a4ab8d83d40b tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.839s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:10 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:17:12 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:17:12 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:17:12 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8120MB free_disk=24.80773162841797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:17:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance df9506c4-4e3d-432e-9e36-c2308db670eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance c8711110-3a8f-4f80-b991-4061faaaa2d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 3496e335-49df-4457-ae6d-c8c8a655277e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 51af821e-6a11-406e-95f6-0cd4501a6c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 191fa449-c6c6-4096-94bb-df2225ad1ce2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:17:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:17:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:17:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:17:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:17:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:17:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG nova.compute.manager [req-e7000126-debd-4a0e-9878-2d09f197dcc0 req-07ad567d-185f-43c0-baf9-23db3dcdc9ef service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received event network-changed-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG nova.compute.manager [req-e7000126-debd-4a0e-9878-2d09f197dcc0 req-07ad567d-185f-43c0-baf9-23db3dcdc9ef service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Refreshing instance network info cache due to event network-changed-c873abf1-01f9-42ec-a4b1-d22cd83f8716. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e7000126-debd-4a0e-9878-2d09f197dcc0 req-07ad567d-185f-43c0-baf9-23db3dcdc9ef service nova] Acquiring lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e7000126-debd-4a0e-9878-2d09f197dcc0 req-07ad567d-185f-43c0-baf9-23db3dcdc9ef service nova] Acquired lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG nova.network.neutron [req-e7000126-debd-4a0e-9878-2d09f197dcc0 req-07ad567d-185f-43c0-baf9-23db3dcdc9ef service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Refreshing network info cache for port c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG nova.network.neutron [req-e7000126-debd-4a0e-9878-2d09f197dcc0 req-07ad567d-185f-43c0-baf9-23db3dcdc9ef service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Updated VIF entry in instance network info cache for port c873abf1-01f9-42ec-a4b1-d22cd83f8716. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG nova.network.neutron [req-e7000126-debd-4a0e-9878-2d09f197dcc0 req-07ad567d-185f-43c0-baf9-23db3dcdc9ef service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Updating instance_info_cache with network_info: [{"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e7000126-debd-4a0e-9878-2d09f197dcc0 req-07ad567d-185f-43c0-baf9-23db3dcdc9ef service nova] Releasing lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "3496e335-49df-4457-ae6d-c8c8a655277e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG nova.objects.instance [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lazy-loading 'flavor' on Instance uuid 3496e335-49df-4457-ae6d-c8c8a655277e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:17:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "3496e335-49df-4457-ae6d-c8c8a655277e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:37 user nova-compute[75813]: INFO nova.compute.manager [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Attaching volume 4d7c8db2-b945-4fa3-a522-7eebfd8c69ed to /dev/vdb
Nov 15 13:17:37 user nova-compute[75813]: DEBUG os_brick.utils [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e0e6b5-2d22-41d4-b1e8-ddb98fc8ddcc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af08c0f-48c9-4e35-8755-11df9e2673f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c91c837-a84f-4f77-93cc-67d89b36122e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef78718-3c37-4b61-a9e0-35a9af4c0242]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:17:37 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:17:37 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fb2e4b-49ba-43f9-a935-8e5cf2e90f91]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG os_brick.utils [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:17:37 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Updating existing volume attachment record: 21f3c74c-2d35-4786-915c-36b86cabd9c7 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:17:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:17:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqwHdJkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:17:42 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:17:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:17:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:17:42 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:17:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:17:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:17:42 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:17:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95f4b6c-3aad-46a1-9842-9d55b9523a02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:17:42 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c27bb2-7c69-44a2-8cba-ccfb48670039]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed] added
Nov 15 13:17:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b372839b-9c5e-43c4-949c-0f52aeaa6e6f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b070e35e-25dc-4d32-b879-2a4486a1ad5a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqwHdJkL {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqwHdJkL" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[61500075-4434-4fb2-b98b-006bd7517f4f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UqwHdJkL'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4aca5a-2587-4597-8a1a-bee53e2d111f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[96787798-b533-4c52-8324-e414fb29eeeb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:17:43 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:17:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:17:43 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:17:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38dca88-5c7e-47b6-95f1-45b7f1035500]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed, portal: 172.16.0.220,3260]
Nov 15 13:17:43 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed, portal: 172.16.0.220,3260] successful.
Nov 15 13:17:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0add6b-bc6a-4321-9d47-2d71a8ce2873]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[02272f22-9655-4787-a766-31045b867820]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:17:43 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:17:43 user nova-compute[75813]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed (non-flash)
Nov 15 13:17:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:17:43 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:17:43 user nova-compute[75813]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed (non-flash)
Nov 15 13:17:43 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[19519fc9-e4cc-438e-943d-4cdd7e55ce3b]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:17:43 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqwHdJkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:17:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:17:44 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23539626637313835', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:17:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539626637313835', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:17:44 user nova-compute[75813]: DEBUG nova.objects.instance [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lazy-loading 'flavor' on Instance uuid 3496e335-49df-4457-ae6d-c8c8a655277e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:17:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:17:44 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:17:44 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:17:44 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:17:44 user nova-compute[75813]:   <serial>4d7c8db2-b945-4fa3-a522-7eebfd8c69ed</serial>
Nov 15 13:17:44 user nova-compute[75813]: </disk>
Nov 15 13:17:44 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:17:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:17:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:17:44 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] No VIF found with MAC fa:16:3e:42:57:12, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:17:44 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-85385d9a-7afa-48a0-9165-385f0a76f96e tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.887s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:17:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "3496e335-49df-4457-ae6d-c8c8a655277e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:17:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:17:47 user nova-compute[75813]: INFO nova.compute.manager [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Detaching volume 4d7c8db2-b945-4fa3-a522-7eebfd8c69ed
Nov 15 13:17:47 user nova-compute[75813]: INFO nova.virt.block_device [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Attempting to driver detach volume 4d7c8db2-b945-4fa3-a522-7eebfd8c69ed from mountpoint /dev/vdb
Nov 15 13:17:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Attempting to detach device vdb from instance 3496e335-49df-4457-ae6d-c8c8a655277e from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:17:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:17:47 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:17:47 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:17:47 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:17:47 user nova-compute[75813]:   <serial>4d7c8db2-b945-4fa3-a522-7eebfd8c69ed</serial>
Nov 15 13:17:47 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:17:47 user nova-compute[75813]: </disk>
Nov 15 13:17:47 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:17:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Successfully detached device vdb from instance 3496e335-49df-4457-ae6d-c8c8a655277e from the persistent domain config.
Nov 15 13:17:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3496e335-49df-4457-ae6d-c8c8a655277e from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:17:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:17:47 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:17:47 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:17:47 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:17:47 user nova-compute[75813]:   <serial>4d7c8db2-b945-4fa3-a522-7eebfd8c69ed</serial>
Nov 15 13:17:47 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:17:47 user nova-compute[75813]: </disk>
Nov 15 13:17:47 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:17:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3496e335-49df-4457-ae6d-c8c8a655277e {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:17:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:17:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Updating instance_info_cache with network_info: [{"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:18:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:18:02 user nova-compute[75813]: INFO nova.compute.claims [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Claim successful on node user
Nov 15 13:18:02 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:18:02 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:18:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG nova.policy [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea5ceaf286514f268b169a27bbfd4006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a3450c054f9490f65fa0a603e699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:18:02 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Creating image(s)
Nov 15 13:18:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "/opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "/opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "/opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "5451d11a1c251653c821a6b327b5af3eb5579c63" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "5451d11a1c251653c821a6b327b5af3eb5579c63" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63.part --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:03 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:18:03 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:18:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63.part --force-share --output=json" returned: 0 in 0.200s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:03 user nova-compute[75813]: DEBUG nova.virt.images [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] 5e485f0e-e73e-4f22-a02b-8d0580e9fcf3 was qcow2, converting to raw {{(pid=75813) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 13:18:03 user nova-compute[75813]: DEBUG nova.privsep.utils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75813) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 13:18:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63.part /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63.converted {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:03 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Successfully created port: 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:18:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63.part /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63.converted" returned: 0 in 0.368s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63.converted --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "5451d11a1c251653c821a6b327b5af3eb5579c63" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.401s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Successfully updated port: 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquired lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63 --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "5451d11a1c251653c821a6b327b5af3eb5579c63" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "5451d11a1c251653c821a6b327b5af3eb5579c63" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-61083927-9711-49ad-a452-52c37ba905cc req-1a0e44cf-9457-4f9c-bf09-9c798749bf09 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-changed-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-61083927-9711-49ad-a452-52c37ba905cc req-1a0e44cf-9457-4f9c-bf09-9c798749bf09 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Refreshing instance network info cache due to event network-changed-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-61083927-9711-49ad-a452-52c37ba905cc req-1a0e44cf-9457-4f9c-bf09-9c798749bf09 service nova] Acquiring lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63 --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63,backing_fmt=raw /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63,backing_fmt=raw /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk 1073741824" returned: 0 in 0.055s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "5451d11a1c251653c821a6b327b5af3eb5579c63" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63 --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Cannot resize image /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Ensure instance console log exists: /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.network.neutron [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updating instance_info_cache with network_info: [{"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Releasing lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Instance network_info: |[{"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-61083927-9711-49ad-a452-52c37ba905cc req-1a0e44cf-9457-4f9c-bf09-9c798749bf09 service nova] Acquired lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.network.neutron [req-61083927-9711-49ad-a452-52c37ba905cc req-1a0e44cf-9457-4f9c-bf09-9c798749bf09 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Refreshing network info cache for port 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Start _get_guest_xml network_info=[{"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T13:17:59Z,direct_url=<?>,disk_format='qcow2',id=5e485f0e-e73e-4f22-a02b-8d0580e9fcf3,min_disk=0,min_ram=0,name='tempest-scenario-img--1113042896',owner='5875a3450c054f9490f65fa0a603e699',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T13:18:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '5e485f0e-e73e-4f22-a02b-8d0580e9fcf3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:18:05 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:18:05 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T13:17:59Z,direct_url=<?>,disk_format='qcow2',id=5e485f0e-e73e-4f22-a02b-8d0580e9fcf3,min_disk=0,min_ram=0,name='tempest-scenario-img--1113042896',owner='5875a3450c054f9490f65fa0a603e699',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T13:18:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1792958751',display_name='tempest-TestMinimumBasicScenario-server-1792958751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1792958751',id=46,image_ref='5e485f0e-e73e-4f22-a02b-8d0580e9fcf3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+f14XlWDfiA5B72cT6b2djcxfrLBwNCO3hL2Q6diNXpVtbS7f9Lj41alAQ+4fFsl7NFsmEbA1TzAjPBhB19S23wsp1TXIl/5KIINHMRi/kzz8GIkvlF4X+g+/Rymr7aA==',key_name='tempest-TestMinimumBasicScenario-833139215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5875a3450c054f9490f65fa0a603e699',ramdisk_id='',reservation_id='r-wn8eu0s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5e485f0e-e73e-4f22-a02b-8d0580e9fcf3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-651110609',owner_user_name='tempest-TestMinimumBasicScenario-651110609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:18:03Z,user_data=None,user_id='ea5ceaf286514f268b169a27bbfd4006',uuid=0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converting VIF {"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dcab1cc-8c') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.objects.instance [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'pci_devices' on Instance uuid 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:18:05 user nova-compute[75813]:   <uuid>0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92</uuid>
Nov 15 13:18:05 user nova-compute[75813]:   <name>instance-0000002e</name>
Nov 15 13:18:05 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:18:05 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:18:05 user nova-compute[75813]:   <metadata>
Nov 15 13:18:05 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:18:05 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:18:05 user nova-compute[75813]:       <nova:name>tempest-TestMinimumBasicScenario-server-1792958751</nova:name>
Nov 15 13:18:05 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:18:05</nova:creationTime>
Nov 15 13:18:05 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:18:05 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:18:05 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:18:05 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:18:05 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:18:05 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:18:05 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:18:05 user nova-compute[75813]:       <nova:owner>
Nov 15 13:18:05 user nova-compute[75813]:         <nova:user uuid="ea5ceaf286514f268b169a27bbfd4006">tempest-TestMinimumBasicScenario-651110609-project-member</nova:user>
Nov 15 13:18:05 user nova-compute[75813]:         <nova:project uuid="5875a3450c054f9490f65fa0a603e699">tempest-TestMinimumBasicScenario-651110609</nova:project>
Nov 15 13:18:05 user nova-compute[75813]:       </nova:owner>
Nov 15 13:18:05 user nova-compute[75813]:       <nova:root type="image" uuid="5e485f0e-e73e-4f22-a02b-8d0580e9fcf3"/>
Nov 15 13:18:05 user nova-compute[75813]:       <nova:ports>
Nov 15 13:18:05 user nova-compute[75813]:         <nova:port uuid="9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f">
Nov 15 13:18:05 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 13:18:05 user nova-compute[75813]:         </nova:port>
Nov 15 13:18:05 user nova-compute[75813]:       </nova:ports>
Nov 15 13:18:05 user nova-compute[75813]:     </nova:instance>
Nov 15 13:18:05 user nova-compute[75813]:   </metadata>
Nov 15 13:18:05 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:18:05 user nova-compute[75813]:     <system>
Nov 15 13:18:05 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:18:05 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:18:05 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:18:05 user nova-compute[75813]:       <entry name="serial">0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92</entry>
Nov 15 13:18:05 user nova-compute[75813]:       <entry name="uuid">0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92</entry>
Nov 15 13:18:05 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:18:05 user nova-compute[75813]:     </system>
Nov 15 13:18:05 user nova-compute[75813]:   </sysinfo>
Nov 15 13:18:05 user nova-compute[75813]:   <os>
Nov 15 13:18:05 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:18:05 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:18:05 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:18:05 user nova-compute[75813]:   </os>
Nov 15 13:18:05 user nova-compute[75813]:   <features>
Nov 15 13:18:05 user nova-compute[75813]:     <acpi/>
Nov 15 13:18:05 user nova-compute[75813]:     <apic/>
Nov 15 13:18:05 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:18:05 user nova-compute[75813]:   </features>
Nov 15 13:18:05 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:18:05 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:18:05 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:18:05 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:18:05 user nova-compute[75813]:   </clock>
Nov 15 13:18:05 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:18:05 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:18:05 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:18:05 user nova-compute[75813]:   </cpu>
Nov 15 13:18:05 user nova-compute[75813]:   <devices>
Nov 15 13:18:05 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:18:05 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:18:05 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk"/>
Nov 15 13:18:05 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:18:05 user nova-compute[75813]:     </disk>
Nov 15 13:18:05 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:18:05 user nova-compute[75813]:       <mac address="fa:16:3e:8f:bc:d5"/>
Nov 15 13:18:05 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:18:05 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:18:05 user nova-compute[75813]:       <target dev="tap9dcab1cc-8c"/>
Nov 15 13:18:05 user nova-compute[75813]:     </interface>
Nov 15 13:18:05 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:18:05 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/console.log" append="off"/>
Nov 15 13:18:05 user nova-compute[75813]:     </serial>
Nov 15 13:18:05 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:18:05 user nova-compute[75813]:     <video>
Nov 15 13:18:05 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:18:05 user nova-compute[75813]:     </video>
Nov 15 13:18:05 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:18:05 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:18:05 user nova-compute[75813]:     </rng>
Nov 15 13:18:05 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:18:05 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:18:05 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:18:05 user nova-compute[75813]:     </memballoon>
Nov 15 13:18:05 user nova-compute[75813]:   </devices>
Nov 15 13:18:05 user nova-compute[75813]: </domain>
Nov 15 13:18:05 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1792958751',display_name='tempest-TestMinimumBasicScenario-server-1792958751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1792958751',id=46,image_ref='5e485f0e-e73e-4f22-a02b-8d0580e9fcf3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+f14XlWDfiA5B72cT6b2djcxfrLBwNCO3hL2Q6diNXpVtbS7f9Lj41alAQ+4fFsl7NFsmEbA1TzAjPBhB19S23wsp1TXIl/5KIINHMRi/kzz8GIkvlF4X+g+/Rymr7aA==',key_name='tempest-TestMinimumBasicScenario-833139215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5875a3450c054f9490f65fa0a603e699',ramdisk_id='',reservation_id='r-wn8eu0s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5e485f0e-e73e-4f22-a02b-8d0580e9fcf3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-651110609',owner_user_name='tempest-TestMinimumBasicScenario-651110609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:18:03Z,user_data=None,user_id='ea5ceaf286514f268b169a27bbfd4006',uuid=0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converting VIF {"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dcab1cc-8c') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG os_vif [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dcab1cc-8c') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fb6f57e-7bc2-54db-9671-2501e324f6da', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dcab1cc-8c, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9dcab1cc-8c, col_values=(('qos', UUID('18aaa058-c9d0-43bd-8292-9b5d59cf319e')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9dcab1cc-8c, col_values=(('external_ids', {'iface-id': '9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:bc:d5', 'vm-uuid': '0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:05 user nova-compute[75813]: INFO os_vif [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dcab1cc-8c')
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] No VIF found with MAC fa:16:3e:8f:bc:d5, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:18:05 user nova-compute[75813]: INFO nova.compute.claims [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Claim successful on node user
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.network.neutron [req-61083927-9711-49ad-a452-52c37ba905cc req-1a0e44cf-9457-4f9c-bf09-9c798749bf09 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updated VIF entry in instance network info cache for port 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.network.neutron [req-61083927-9711-49ad-a452-52c37ba905cc req-1a0e44cf-9457-4f9c-bf09-9c798749bf09 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updating instance_info_cache with network_info: [{"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-61083927-9711-49ad-a452-52c37ba905cc req-1a0e44cf-9457-4f9c-bf09-9c798749bf09 service nova] Releasing lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:18:06 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:18:06 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG nova.policy [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '172f130186f04b45a24337416d54780a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e0c39eb5ff4a26a35c7e07d0ed66f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:18:06 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Creating image(s)
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "/opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "/opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "/opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG nova.compute.manager [req-2ce7b892-0382-4e45-86c8-60ea2d2f393e req-cde1b667-05f2-48a9-b5d9-84e8e4c1558e service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-changed-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG nova.compute.manager [req-2ce7b892-0382-4e45-86c8-60ea2d2f393e req-cde1b667-05f2-48a9-b5d9-84e8e4c1558e service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Refreshing instance network info cache due to event network-changed-6b13cb80-a670-4df8-9d5a-56c84170e3c2. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2ce7b892-0382-4e45-86c8-60ea2d2f393e req-cde1b667-05f2-48a9-b5d9-84e8e4c1558e service nova] Acquiring lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2ce7b892-0382-4e45-86c8-60ea2d2f393e req-cde1b667-05f2-48a9-b5d9-84e8e4c1558e service nova] Acquired lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG nova.network.neutron [req-2ce7b892-0382-4e45-86c8-60ea2d2f393e req-cde1b667-05f2-48a9-b5d9-84e8e4c1558e service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Refreshing network info cache for port 6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.216s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk 1073741824" returned: 0 in 0.058s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG nova.objects.instance [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'flavor' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:06 user nova-compute[75813]: INFO nova.compute.manager [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Attaching volume a780249d-6aa8-4592-b686-045155c81093 to /dev/vdb
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.utils [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bace4f3c-364b-4290-9776-0648663eec4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Cannot resize image /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Ensure instance console log exists: /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ec531-d01f-4ff8-861c-0a998c8c1ed3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[39efc252-88ff-4f64-af67-05795755f9d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[deca8a40-32e5-40c0-a095-a8cdf9899367]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:18:07 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afeab99-3465-4e66-bb1d-ac772ec7c364]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.utils [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updating existing volume attachment record: a9a24a3e-83d7-4b15-8c6e-2a27518d67bf {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Successfully created port: d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG nova.network.neutron [req-2ce7b892-0382-4e45-86c8-60ea2d2f393e req-cde1b667-05f2-48a9-b5d9-84e8e4c1558e service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updated VIF entry in instance network info cache for port 6b13cb80-a670-4df8-9d5a-56c84170e3c2. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG nova.network.neutron [req-2ce7b892-0382-4e45-86c8-60ea2d2f393e req-cde1b667-05f2-48a9-b5d9-84e8e4c1558e service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updating instance_info_cache with network_info: [{"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:07 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3496e335-49df-4457-ae6d-c8c8a655277e is timed out.
Nov 15 13:18:07 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Successfully detached device vdb from instance 3496e335-49df-4457-ae6d-c8c8a655277e from the live domain config.
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2ce7b892-0382-4e45-86c8-60ea2d2f393e req-cde1b667-05f2-48a9-b5d9-84e8e4c1558e service nova] Releasing lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqwHdJkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:18:07 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[904ce13d-4bfb-4199-93b5-a516e1bf781d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:18:07 user nova-compute[75813]: No targets found.
Nov 15 13:18:07 user nova-compute[75813]: iSNS:
Nov 15 13:18:07 user nova-compute[75813]: No targets found.
Nov 15 13:18:07 user nova-compute[75813]: STATIC:
Nov 15 13:18:07 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7
Nov 15 13:18:07 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:18:07 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:18:07 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed
Nov 15 13:18:07 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:18:07 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:18:07 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540
Nov 15 13:18:07 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:18:07 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:18:07 user nova-compute[75813]: FIRMWARE:
Nov 15 13:18:07 user nova-compute[75813]: No targets found.
Nov 15 13:18:07 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:18:07 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:18:07 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ccc673-ace3-47c3-8683-3359f0f320a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[29981ca2-3e81-4319-9001-c3448534a9da]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:18:07 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:18:07 user nova-compute[75813]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed (non-flash)
Nov 15 13:18:07 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:18:07 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:18:07 user nova-compute[75813]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed (non-flash)
Nov 15 13:18:07 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55505d8a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed'): ({'sdc'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Removing single pathed devices sdc {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ca6902-e909-4a2e-9f8b-01719ea90c47]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5222b937-af61-4ac4-8992-95097b292f66]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Flushing IO for device /dev/sdc {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14d2b94-8644-4825-8955-4aa05f49a835]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.067s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2522262e-da5a-4e7f-bdaa-3606afddfe89]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e0edaa-0048-4967-a485-487f5d828635]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[04513883-b9ab-4b2b-82d2-a2650fb16f20]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed, portal: 172.16.0.220,3260]
Nov 15 13:18:07 user nova-compute[75813]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed, portal: 172.16.0.220,3260] successful.
Nov 15 13:18:07 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d7c8db2-b945-4fa3-a522-7eebfd8c69ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a51f7f7-6957-4a32-9080-d178bf365ff7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] <== disconnect_volume: return (406ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:18:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Successfully updated port: d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "refresh_cache-55b865f3-afc6-4b3f-a7af-392dfd7b063d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquired lock "refresh_cache-55b865f3-afc6-4b3f-a7af-392dfd7b063d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-ecb7f895-a0de-405d-834d-32ad395083c9 req-ef069c50-b24f-40e8-aaa7-49865f602d90 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received event network-changed-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-ecb7f895-a0de-405d-834d-32ad395083c9 req-ef069c50-b24f-40e8-aaa7-49865f602d90 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Refreshing instance network info cache due to event network-changed-d0b85a23-2241-47fb-8c74-aea684638bb1. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ecb7f895-a0de-405d-834d-32ad395083c9 req-ef069c50-b24f-40e8-aaa7-49865f602d90 service nova] Acquiring lock "refresh_cache-55b865f3-afc6-4b3f-a7af-392dfd7b063d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.network.neutron [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Updating instance_info_cache with network_info: [{"id": "d0b85a23-2241-47fb-8c74-aea684638bb1", "address": "fa:16:3e:ef:f1:71", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b85a23-22", "ovs_interfaceid": "d0b85a23-2241-47fb-8c74-aea684638bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Releasing lock "refresh_cache-55b865f3-afc6-4b3f-a7af-392dfd7b063d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Instance network_info: |[{"id": "d0b85a23-2241-47fb-8c74-aea684638bb1", "address": "fa:16:3e:ef:f1:71", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b85a23-22", "ovs_interfaceid": "d0b85a23-2241-47fb-8c74-aea684638bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ecb7f895-a0de-405d-834d-32ad395083c9 req-ef069c50-b24f-40e8-aaa7-49865f602d90 service nova] Acquired lock "refresh_cache-55b865f3-afc6-4b3f-a7af-392dfd7b063d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.network.neutron [req-ecb7f895-a0de-405d-834d-32ad395083c9 req-ef069c50-b24f-40e8-aaa7-49865f602d90 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Refreshing network info cache for port d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Start _get_guest_xml network_info=[{"id": "d0b85a23-2241-47fb-8c74-aea684638bb1", "address": "fa:16:3e:ef:f1:71", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b85a23-22", "ovs_interfaceid": "d0b85a23-2241-47fb-8c74-aea684638bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:18:08 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:18:08 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] No waiting events found dispatching network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:08 user nova-compute[75813]: WARNING nova.compute.manager [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received unexpected event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f for instance with vm_state building and task_state spawning.
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] No waiting events found dispatching network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:08 user nova-compute[75813]: WARNING nova.compute.manager [req-d393726e-7e35-489d-b978-76b2ae59ddf7 req-6ca8505b-1638-45f3-ba15-04f62553169b service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received unexpected event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f for instance with vm_state building and task_state spawning.
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1956988430',display_name='tempest-VolumesActionsTest-instance-1956988430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1956988430',id=47,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7e0c39eb5ff4a26a35c7e07d0ed66f5',ramdisk_id='',reservation_id='r-c5ye00s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1071662127',owner_user_name='tempest-VolumesActionsTest-1071662127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:18:06Z,user_data=None,user_id='172f130186f04b45a24337416d54780a',uuid=55b865f3-afc6-4b3f-a7af-392dfd7b063d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0b85a23-2241-47fb-8c74-aea684638bb1", "address": "fa:16:3e:ef:f1:71", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b85a23-22", "ovs_interfaceid": "d0b85a23-2241-47fb-8c74-aea684638bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converting VIF {"id": "d0b85a23-2241-47fb-8c74-aea684638bb1", "address": "fa:16:3e:ef:f1:71", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b85a23-22", "ovs_interfaceid": "d0b85a23-2241-47fb-8c74-aea684638bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:71,bridge_name='br-int',has_traffic_filtering=True,id=d0b85a23-2241-47fb-8c74-aea684638bb1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b85a23-22') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.objects.instance [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lazy-loading 'pci_devices' on Instance uuid 55b865f3-afc6-4b3f-a7af-392dfd7b063d {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:18:08 user nova-compute[75813]:   <uuid>55b865f3-afc6-4b3f-a7af-392dfd7b063d</uuid>
Nov 15 13:18:08 user nova-compute[75813]:   <name>instance-0000002f</name>
Nov 15 13:18:08 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:18:08 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:18:08 user nova-compute[75813]:   <metadata>
Nov 15 13:18:08 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:18:08 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:18:08 user nova-compute[75813]:       <nova:name>tempest-VolumesActionsTest-instance-1956988430</nova:name>
Nov 15 13:18:08 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:18:08</nova:creationTime>
Nov 15 13:18:08 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:18:08 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:18:08 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:18:08 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:18:08 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:18:08 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:18:08 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:18:08 user nova-compute[75813]:       <nova:owner>
Nov 15 13:18:08 user nova-compute[75813]:         <nova:user uuid="172f130186f04b45a24337416d54780a">tempest-VolumesActionsTest-1071662127-project-member</nova:user>
Nov 15 13:18:08 user nova-compute[75813]:         <nova:project uuid="a7e0c39eb5ff4a26a35c7e07d0ed66f5">tempest-VolumesActionsTest-1071662127</nova:project>
Nov 15 13:18:08 user nova-compute[75813]:       </nova:owner>
Nov 15 13:18:08 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:18:08 user nova-compute[75813]:       <nova:ports>
Nov 15 13:18:08 user nova-compute[75813]:         <nova:port uuid="d0b85a23-2241-47fb-8c74-aea684638bb1">
Nov 15 13:18:08 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 13:18:08 user nova-compute[75813]:         </nova:port>
Nov 15 13:18:08 user nova-compute[75813]:       </nova:ports>
Nov 15 13:18:08 user nova-compute[75813]:     </nova:instance>
Nov 15 13:18:08 user nova-compute[75813]:   </metadata>
Nov 15 13:18:08 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:18:08 user nova-compute[75813]:     <system>
Nov 15 13:18:08 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:18:08 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:18:08 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:18:08 user nova-compute[75813]:       <entry name="serial">55b865f3-afc6-4b3f-a7af-392dfd7b063d</entry>
Nov 15 13:18:08 user nova-compute[75813]:       <entry name="uuid">55b865f3-afc6-4b3f-a7af-392dfd7b063d</entry>
Nov 15 13:18:08 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:18:08 user nova-compute[75813]:     </system>
Nov 15 13:18:08 user nova-compute[75813]:   </sysinfo>
Nov 15 13:18:08 user nova-compute[75813]:   <os>
Nov 15 13:18:08 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:18:08 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:18:08 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:18:08 user nova-compute[75813]:   </os>
Nov 15 13:18:08 user nova-compute[75813]:   <features>
Nov 15 13:18:08 user nova-compute[75813]:     <acpi/>
Nov 15 13:18:08 user nova-compute[75813]:     <apic/>
Nov 15 13:18:08 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:18:08 user nova-compute[75813]:   </features>
Nov 15 13:18:08 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:18:08 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:18:08 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:18:08 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:18:08 user nova-compute[75813]:   </clock>
Nov 15 13:18:08 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:18:08 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:18:08 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:18:08 user nova-compute[75813]:   </cpu>
Nov 15 13:18:08 user nova-compute[75813]:   <devices>
Nov 15 13:18:08 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:18:08 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:18:08 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk"/>
Nov 15 13:18:08 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:18:08 user nova-compute[75813]:     </disk>
Nov 15 13:18:08 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:18:08 user nova-compute[75813]:       <mac address="fa:16:3e:ef:f1:71"/>
Nov 15 13:18:08 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:18:08 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:18:08 user nova-compute[75813]:       <target dev="tapd0b85a23-22"/>
Nov 15 13:18:08 user nova-compute[75813]:     </interface>
Nov 15 13:18:08 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:18:08 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/console.log" append="off"/>
Nov 15 13:18:08 user nova-compute[75813]:     </serial>
Nov 15 13:18:08 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:18:08 user nova-compute[75813]:     <video>
Nov 15 13:18:08 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:18:08 user nova-compute[75813]:     </video>
Nov 15 13:18:08 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:18:08 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:18:08 user nova-compute[75813]:     </rng>
Nov 15 13:18:08 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:18:08 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:18:08 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:18:08 user nova-compute[75813]:     </memballoon>
Nov 15 13:18:08 user nova-compute[75813]:   </devices>
Nov 15 13:18:08 user nova-compute[75813]: </domain>
Nov 15 13:18:08 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1956988430',display_name='tempest-VolumesActionsTest-instance-1956988430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1956988430',id=47,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7e0c39eb5ff4a26a35c7e07d0ed66f5',ramdisk_id='',reservation_id='r-c5ye00s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1071662127',owner_user_name='tempest-VolumesActionsTest-1071662127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:18:06Z,user_data=None,user_id='172f130186f04b45a24337416d54780a',uuid=55b865f3-afc6-4b3f-a7af-392dfd7b063d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0b85a23-2241-47fb-8c74-aea684638bb1", "address": "fa:16:3e:ef:f1:71", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b85a23-22", "ovs_interfaceid": "d0b85a23-2241-47fb-8c74-aea684638bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converting VIF {"id": "d0b85a23-2241-47fb-8c74-aea684638bb1", "address": "fa:16:3e:ef:f1:71", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b85a23-22", "ovs_interfaceid": "d0b85a23-2241-47fb-8c74-aea684638bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:71,bridge_name='br-int',has_traffic_filtering=True,id=d0b85a23-2241-47fb-8c74-aea684638bb1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b85a23-22') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG os_vif [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:71,bridge_name='br-int',has_traffic_filtering=True,id=d0b85a23-2241-47fb-8c74-aea684638bb1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b85a23-22') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cb3adbf-a7be-5cd1-87de-a2e5ade2c245', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0b85a23-22, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0b85a23-22, col_values=(('qos', UUID('1ffdb39a-c97f-475e-bce7-b6e16267a992')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0b85a23-22, col_values=(('external_ids', {'iface-id': 'd0b85a23-2241-47fb-8c74-aea684638bb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:f1:71', 'vm-uuid': '55b865f3-afc6-4b3f-a7af-392dfd7b063d'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:08 user nova-compute[75813]: INFO os_vif [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:71,bridge_name='br-int',has_traffic_filtering=True,id=d0b85a23-2241-47fb-8c74-aea684638bb1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b85a23-22')
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] No VIF found with MAC fa:16:3e:ef:f1:71, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.network.neutron [req-ecb7f895-a0de-405d-834d-32ad395083c9 req-ef069c50-b24f-40e8-aaa7-49865f602d90 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Updated VIF entry in instance network info cache for port d0b85a23-2241-47fb-8c74-aea684638bb1. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG nova.network.neutron [req-ecb7f895-a0de-405d-834d-32ad395083c9 req-ef069c50-b24f-40e8-aaa7-49865f602d90 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Updating instance_info_cache with network_info: [{"id": "d0b85a23-2241-47fb-8c74-aea684638bb1", "address": "fa:16:3e:ef:f1:71", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b85a23-22", "ovs_interfaceid": "d0b85a23-2241-47fb-8c74-aea684638bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ecb7f895-a0de-405d-834d-32ad395083c9 req-ef069c50-b24f-40e8-aaa7-49865f602d90 service nova] Releasing lock "refresh_cache-55b865f3-afc6-4b3f-a7af-392dfd7b063d" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:18:09 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:18:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:18:09 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Instance spawned successfully.
Nov 15 13:18:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:18:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:09 user nova-compute[75813]: INFO nova.compute.manager [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Took 6.75 seconds to spawn the instance on the hypervisor.
Nov 15 13:18:09 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:18:09 user nova-compute[75813]: INFO nova.compute.manager [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Took 7.47 seconds to build instance.
Nov 15 13:18:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0a4127b9-8836-4446-8eaf-d881b0049ed8 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.575s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-a81be903-6cc0-462d-9b7c-ff24da7bbf72 req-e6fdf31c-fa89-43fa-831f-845bfa79836a service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a81be903-6cc0-462d-9b7c-ff24da7bbf72 req-e6fdf31c-fa89-43fa-831f-845bfa79836a service nova] Acquiring lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a81be903-6cc0-462d-9b7c-ff24da7bbf72 req-e6fdf31c-fa89-43fa-831f-845bfa79836a service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a81be903-6cc0-462d-9b7c-ff24da7bbf72 req-e6fdf31c-fa89-43fa-831f-845bfa79836a service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-a81be903-6cc0-462d-9b7c-ff24da7bbf72 req-e6fdf31c-fa89-43fa-831f-845bfa79836a service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] No waiting events found dispatching network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:10 user nova-compute[75813]: WARNING nova.compute.manager [req-a81be903-6cc0-462d-9b7c-ff24da7bbf72 req-e6fdf31c-fa89-43fa-831f-845bfa79836a service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received unexpected event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 for instance with vm_state building and task_state spawning.
Nov 15 13:18:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:18:12 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Instance spawned successfully.
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-e541ef1f-31c3-433c-87fa-35758b294a46 req-98a98b64-04b8-4ac4-ab3c-26daca2a6782 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e541ef1f-31c3-433c-87fa-35758b294a46 req-98a98b64-04b8-4ac4-ab3c-26daca2a6782 service nova] Acquiring lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e541ef1f-31c3-433c-87fa-35758b294a46 req-98a98b64-04b8-4ac4-ab3c-26daca2a6782 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e541ef1f-31c3-433c-87fa-35758b294a46 req-98a98b64-04b8-4ac4-ab3c-26daca2a6782 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-e541ef1f-31c3-433c-87fa-35758b294a46 req-98a98b64-04b8-4ac4-ab3c-26daca2a6782 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] No waiting events found dispatching network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:12 user nova-compute[75813]: WARNING nova.compute.manager [req-e541ef1f-31c3-433c-87fa-35758b294a46 req-98a98b64-04b8-4ac4-ab3c-26daca2a6782 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received unexpected event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 for instance with vm_state building and task_state spawning.
Nov 15 13:18:12 user nova-compute[75813]: INFO nova.compute.manager [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lazy-loading 'flavor' on Instance uuid 3496e335-49df-4457-ae6d-c8c8a655277e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c2a33be7-619c-45f2-bfd7-eb1ba62dbdce tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.799s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:12 user nova-compute[75813]: INFO nova.compute.manager [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Took 7.30 seconds to build instance.
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bc638153-f3b2-4622-8f64-2fc7e4d2b1b8 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.398s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afNHiJCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:18:12 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:18:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:18:12 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:18:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:18:12 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c4f838-5dcd-4566-a28b-11d6cbaf9adf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:18:13 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9521590-8a45-484b-9f79-d1164343275c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093] added
Nov 15 13:18:13 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fae3dfa-f076-4934-90f8-6f4a303c3bc5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[903cec08-12ff-4cb0-b511-4574c3b09c9e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afNHiJCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afNHiJCE" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5176f540-fe33-4a0e-a8c6-ce5c470e8a84]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'afNHiJCE'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03c0d90-2ce7-4b43-9071-a39ea2024ad4]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30d563d-380d-4b6a-8358-904691f1aeb5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:18:13 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:18:13 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:18:13 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:18:13 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35f2943-12a6-400a-8543-c712f7121700]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093, portal: 172.16.0.220,3260]
Nov 15 13:18:13 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093, portal: 172.16.0.220,3260] successful.
Nov 15 13:18:13 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5a41e1-2da9-46eb-b53c-0a82e1f8ec69]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7180b4c0-8fb6-40d4-966d-d3eda208e18d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:18:13 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:18:13 user nova-compute[75813]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:18:13 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:18:13 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:18:13 user nova-compute[75813]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:18:13 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.444s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d68b5b-5953-42c3-8739-92d63d6225b7]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afNHiJCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '26638653062376538', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638653062376538', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG nova.objects.instance [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'flavor' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:18:14 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:18:14 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:18:14 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:18:14 user nova-compute[75813]:   <serial>a780249d-6aa8-4592-b686-045155c81093</serial>
Nov 15 13:18:14 user nova-compute[75813]: </disk>
Nov 15 13:18:14 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:18:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No VIF found with MAC fa:16:3e:f0:91:72, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:18:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e33e47ce-ba89-405a-a2f8-53da7ad13b0e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.156s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:16 user nova-compute[75813]: INFO nova.compute.manager [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Rescuing
Nov 15 13:18:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquired lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:16 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:18:16 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8056MB free_disk=24.781063079833984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance df9506c4-4e3d-432e-9e36-c2308db670eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance c8711110-3a8f-4f80-b991-4061faaaa2d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 3496e335-49df-4457-ae6d-c8c8a655277e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 51af821e-6a11-406e-95f6-0cd4501a6c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 191fa449-c6c6-4096-94bb-df2225ad1ce2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 55b865f3-afc6-4b3f-a7af-392dfd7b063d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:18:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updating instance_info_cache with network_info: [{"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Releasing lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-b4bce19a-a116-478b-a540-062ead6d0f11 req-cb188d95-5089-425c-8310-bd29764fac12 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b4bce19a-a116-478b-a540-062ead6d0f11 req-cb188d95-5089-425c-8310-bd29764fac12 service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b4bce19a-a116-478b-a540-062ead6d0f11 req-cb188d95-5089-425c-8310-bd29764fac12 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b4bce19a-a116-478b-a540-062ead6d0f11 req-cb188d95-5089-425c-8310-bd29764fac12 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-b4bce19a-a116-478b-a540-062ead6d0f11 req-cb188d95-5089-425c-8310-bd29764fac12 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:17 user nova-compute[75813]: WARNING nova.compute.manager [req-b4bce19a-a116-478b-a540-062ead6d0f11 req-cb188d95-5089-425c-8310-bd29764fac12 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state active and task_state rescuing.
Nov 15 13:18:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:18:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Instance destroyed successfully.
Nov 15 13:18:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Attempting rescue
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75813) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Instance directory exists: not creating {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 13:18:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Creating image(s)
Nov 15 13:18:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "/opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "/opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'trusted_certs' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.rescue {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.rescue" returned: 0 in 0.051s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'migration_context' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.objects.base [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<51af821e-6a11-406e-95f6-0cd4501a6c33> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Start _get_guest_xml network_info=[{"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "vif_mac": "fa:16:3e:f0:91:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4d13142f-f571-4806-9713-890c0afeb458', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'resources' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.objects.base [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<51af821e-6a11-406e-95f6-0cd4501a6c33> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'numa_topology' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.objects.base [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<51af821e-6a11-406e-95f6-0cd4501a6c33> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:18:18 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:18:18 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.objects.base [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<51af821e-6a11-406e-95f6-0cd4501a6c33> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-641669488',display_name='tempest-ServerRescueNegativeTestJSON-server-641669488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-641669488',id=44,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlylzbWO8l7Mulp5btslf0xF6sHF5XDSRD62oeDaTad9apG2CbMDrSjILb7W39BYYIjc+s0JZzh4+4huOUsOKMl8g6/VlGYg4vOb3fJ1SX1SfNIK0YKAeymlNj/oiAVpA==',key_name='tempest-keypair-2136231595',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:16:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-9l00sjy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=51af821e-6a11-406e-95f6-0cd4501a6c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "vif_mac": "fa:16:3e:f0:91:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "vif_mac": "fa:16:3e:f0:91:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:91:72,bridge_name='br-int',has_traffic_filtering=True,id=6b13cb80-a670-4df8-9d5a-56c84170e3c2,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13cb80-a6') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'pci_devices' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.objects.base [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Object Instance<51af821e-6a11-406e-95f6-0cd4501a6c33> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75813) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:18:18 user nova-compute[75813]:   <uuid>51af821e-6a11-406e-95f6-0cd4501a6c33</uuid>
Nov 15 13:18:18 user nova-compute[75813]:   <name>instance-0000002c</name>
Nov 15 13:18:18 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:18:18 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:18:18 user nova-compute[75813]:   <metadata>
Nov 15 13:18:18 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:18:18 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:18:18 user nova-compute[75813]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-641669488</nova:name>
Nov 15 13:18:18 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:18:18</nova:creationTime>
Nov 15 13:18:18 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:18:18 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:18:18 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:18:18 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:18:18 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:18:18 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:18:18 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:18:18 user nova-compute[75813]:       <nova:owner>
Nov 15 13:18:18 user nova-compute[75813]:         <nova:user uuid="754cbdd42e894349bdacf3a0c7ba06cc">tempest-ServerRescueNegativeTestJSON-1475327670-project-member</nova:user>
Nov 15 13:18:18 user nova-compute[75813]:         <nova:project uuid="71da470a3bdb4093bc2b5db0b66fa08e">tempest-ServerRescueNegativeTestJSON-1475327670</nova:project>
Nov 15 13:18:18 user nova-compute[75813]:       </nova:owner>
Nov 15 13:18:18 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:18:18 user nova-compute[75813]:       <nova:ports>
Nov 15 13:18:18 user nova-compute[75813]:         <nova:port uuid="6b13cb80-a670-4df8-9d5a-56c84170e3c2">
Nov 15 13:18:18 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 13:18:18 user nova-compute[75813]:         </nova:port>
Nov 15 13:18:18 user nova-compute[75813]:       </nova:ports>
Nov 15 13:18:18 user nova-compute[75813]:     </nova:instance>
Nov 15 13:18:18 user nova-compute[75813]:   </metadata>
Nov 15 13:18:18 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:18:18 user nova-compute[75813]:     <system>
Nov 15 13:18:18 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:18:18 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:18:18 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:18:18 user nova-compute[75813]:       <entry name="serial">51af821e-6a11-406e-95f6-0cd4501a6c33</entry>
Nov 15 13:18:18 user nova-compute[75813]:       <entry name="uuid">51af821e-6a11-406e-95f6-0cd4501a6c33</entry>
Nov 15 13:18:18 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:18:18 user nova-compute[75813]:     </system>
Nov 15 13:18:18 user nova-compute[75813]:   </sysinfo>
Nov 15 13:18:18 user nova-compute[75813]:   <os>
Nov 15 13:18:18 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:18:18 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:18:18 user nova-compute[75813]:   </os>
Nov 15 13:18:18 user nova-compute[75813]:   <features>
Nov 15 13:18:18 user nova-compute[75813]:     <acpi/>
Nov 15 13:18:18 user nova-compute[75813]:     <apic/>
Nov 15 13:18:18 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:18:18 user nova-compute[75813]:   </features>
Nov 15 13:18:18 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:18:18 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:18:18 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:18:18 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:18:18 user nova-compute[75813]:   </clock>
Nov 15 13:18:18 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:18:18 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:18:18 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:18:18 user nova-compute[75813]:   </cpu>
Nov 15 13:18:18 user nova-compute[75813]:   <devices>
Nov 15 13:18:18 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:18:18 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:18:18 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.rescue"/>
Nov 15 13:18:18 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:18:18 user nova-compute[75813]:     </disk>
Nov 15 13:18:18 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:18:18 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:18:18 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk"/>
Nov 15 13:18:18 user nova-compute[75813]:       <target dev="vdb" bus="virtio"/>
Nov 15 13:18:18 user nova-compute[75813]:     </disk>
Nov 15 13:18:18 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:18:18 user nova-compute[75813]:       <mac address="fa:16:3e:f0:91:72"/>
Nov 15 13:18:18 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:18:18 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:18:18 user nova-compute[75813]:       <target dev="tap6b13cb80-a6"/>
Nov 15 13:18:18 user nova-compute[75813]:     </interface>
Nov 15 13:18:18 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:18:18 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/console.log" append="off"/>
Nov 15 13:18:18 user nova-compute[75813]:     </serial>
Nov 15 13:18:18 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:18:18 user nova-compute[75813]:     <video>
Nov 15 13:18:18 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:18:18 user nova-compute[75813]:     </video>
Nov 15 13:18:18 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:18:18 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:18:18 user nova-compute[75813]:     </rng>
Nov 15 13:18:18 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:18:18 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:18:18 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:18:18 user nova-compute[75813]:     </memballoon>
Nov 15 13:18:18 user nova-compute[75813]:   </devices>
Nov 15 13:18:18 user nova-compute[75813]: </domain>
Nov 15 13:18:18 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:18:18 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Instance destroyed successfully.
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:18:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] No VIF found with MAC fa:16:3e:f0:91:72, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:18:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-65bf4b58-1b4e-4994-99bc-5200eced0591 req-fd270b7e-922d-4ca9-a99e-2f5c9a2698e6 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-65bf4b58-1b4e-4994-99bc-5200eced0591 req-fd270b7e-922d-4ca9-a99e-2f5c9a2698e6 service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-65bf4b58-1b4e-4994-99bc-5200eced0591 req-fd270b7e-922d-4ca9-a99e-2f5c9a2698e6 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-65bf4b58-1b4e-4994-99bc-5200eced0591 req-fd270b7e-922d-4ca9-a99e-2f5c9a2698e6 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-65bf4b58-1b4e-4994-99bc-5200eced0591 req-fd270b7e-922d-4ca9-a99e-2f5c9a2698e6 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:19 user nova-compute[75813]: WARNING nova.compute.manager [req-65bf4b58-1b4e-4994-99bc-5200eced0591 req-fd270b7e-922d-4ca9-a99e-2f5c9a2698e6 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state active and task_state rescuing.
Nov 15 13:18:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:21 user nova-compute[75813]: WARNING nova.compute.manager [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state active and task_state rescuing.
Nov 15 13:18:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:21 user nova-compute[75813]: WARNING nova.compute.manager [req-66acd5d7-253b-4348-bcbc-03f590eca6c8 req-7dba1fe5-9a21-48f0-9048-1ff17d925619 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state active and task_state rescuing.
Nov 15 13:18:22 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a51f7429-ee8b-45dd-be74-db2c8b0d768e tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:18:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-0cd63b0b-52ee-444c-b3dc-eb0619b5a561 req-bed9f5d1-cbd9-4591-a7a0-7449e40d187c service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received event network-changed-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG nova.compute.manager [req-0cd63b0b-52ee-444c-b3dc-eb0619b5a561 req-bed9f5d1-cbd9-4591-a7a0-7449e40d187c service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Refreshing instance network info cache due to event network-changed-c873abf1-01f9-42ec-a4b1-d22cd83f8716. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0cd63b0b-52ee-444c-b3dc-eb0619b5a561 req-bed9f5d1-cbd9-4591-a7a0-7449e40d187c service nova] Acquiring lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0cd63b0b-52ee-444c-b3dc-eb0619b5a561 req-bed9f5d1-cbd9-4591-a7a0-7449e40d187c service nova] Acquired lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG nova.network.neutron [req-0cd63b0b-52ee-444c-b3dc-eb0619b5a561 req-bed9f5d1-cbd9-4591-a7a0-7449e40d187c service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Refreshing network info cache for port c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "3496e335-49df-4457-ae6d-c8c8a655277e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:37 user nova-compute[75813]: INFO nova.compute.manager [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Terminating instance
Nov 15 13:18:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG nova.network.neutron [req-0cd63b0b-52ee-444c-b3dc-eb0619b5a561 req-bed9f5d1-cbd9-4591-a7a0-7449e40d187c service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Updated VIF entry in instance network info cache for port c873abf1-01f9-42ec-a4b1-d22cd83f8716. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG nova.network.neutron [req-0cd63b0b-52ee-444c-b3dc-eb0619b5a561 req-bed9f5d1-cbd9-4591-a7a0-7449e40d187c service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Updating instance_info_cache with network_info: [{"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0cd63b0b-52ee-444c-b3dc-eb0619b5a561 req-bed9f5d1-cbd9-4591-a7a0-7449e40d187c service nova] Releasing lock "refresh_cache-3496e335-49df-4457-ae6d-c8c8a655277e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:18:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Instance destroyed successfully.
Nov 15 13:18:38 user nova-compute[75813]: DEBUG nova.objects.instance [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lazy-loading 'resources' on Instance uuid 3496e335-49df-4457-ae6d-c8c8a655277e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:15:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-816695242',display_name='tempest-TestStampPattern-server-816695242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-816695242',id=43,image_ref='98fd0e32-61e3-4093-9a9c-ec7829759fc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLKrkLu7f9w3+U6cD1j5d4t/hb+GATdYey2Mtp5Sm2zl/kk0TYZnXEXQqeVbbwwqJDQaj0o7WXy4ErZdlp6eJTA23hMjmFtD1DfWfDHzibymmApmthDuNQCp3ogmew4qQ==',key_name='tempest-TestStampPattern-1022702423',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:15:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c994fd1a1654264a408318e33304679',ramdisk_id='',reservation_id='r-ftfu6ben',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='df9506c4-4e3d-432e-9e36-c2308db670eb',image_min_disk='1',image_min_ram='0',image_owner_id='0c994fd1a1654264a408318e33304679',image_owner_project_name='tempest-TestStampPattern-1055506233',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1055506233-project-member',image_user_id='c260e661d4104e7888fdd3fc4257cc4d',owner_project_name='tempest-TestStampPattern-1055506233',owner_user_name='tempest-TestStampPattern-1055506233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:15:52Z,user_data=None,user_id='c260e661d4104e7888fdd3fc4257cc4d',uuid=3496e335-49df-4457-ae6d-c8c8a655277e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converting VIF {"id": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "address": "fa:16:3e:42:57:12", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc873abf1-01", "ovs_interfaceid": "c873abf1-01f9-42ec-a4b1-d22cd83f8716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:57:12,bridge_name='br-int',has_traffic_filtering=True,id=c873abf1-01f9-42ec-a4b1-d22cd83f8716,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc873abf1-01') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG os_vif [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:57:12,bridge_name='br-int',has_traffic_filtering=True,id=c873abf1-01f9-42ec-a4b1-d22cd83f8716,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc873abf1-01') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc873abf1-01, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2efbbcc9-dffe-4044-b41f-91948b973822) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:38 user nova-compute[75813]: INFO os_vif [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:57:12,bridge_name='br-int',has_traffic_filtering=True,id=c873abf1-01f9-42ec-a4b1-d22cd83f8716,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc873abf1-01')
Nov 15 13:18:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Deleting instance files /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e_del
Nov 15 13:18:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Deletion of /opt/stack/data/nova/instances/3496e335-49df-4457-ae6d-c8c8a655277e_del complete
Nov 15 13:18:38 user nova-compute[75813]: INFO nova.compute.manager [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 13:18:38 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:18:38 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:39 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Took 0.76 seconds to deallocate network for instance.
Nov 15 13:18:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-4cafcdca-e29c-4e40-88dd-8627b3ba9e20 req-f144f1be-9c3f-47aa-9f40-154387e075b6 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received event network-vif-deleted-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received event network-vif-unplugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] Acquiring lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] Lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] Lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] No waiting events found dispatching network-vif-unplugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:39 user nova-compute[75813]: WARNING nova.compute.manager [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received unexpected event network-vif-unplugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 for instance with vm_state deleted and task_state None.
Nov 15 13:18:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received event network-vif-plugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] Acquiring lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] Lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] Lock "3496e335-49df-4457-ae6d-c8c8a655277e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] No waiting events found dispatching network-vif-plugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:39 user nova-compute[75813]: WARNING nova.compute.manager [req-22f54f88-21c0-4f96-9cc3-b69de7dda9ac req-7588cdc5-5d46-4fa8-8739-eee0ae8c60d7 service nova] [instance: 3496e335-49df-4457-ae6d-c8c8a655277e] Received unexpected event network-vif-plugged-c873abf1-01f9-42ec-a4b1-d22cd83f8716 for instance with vm_state deleted and task_state None.
Nov 15 13:18:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:39 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Deleted allocations for instance 3496e335-49df-4457-ae6d-c8c8a655277e
Nov 15 13:18:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b6ce9bff-e209-4b7b-b764-622aca6dd6ea tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "3496e335-49df-4457-ae6d-c8c8a655277e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.076s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-67bbabe0-6e1e-40ab-8aa9-fab2073b951b req-dfb5f22d-815f-406e-b672-2111638ae78e service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received event network-changed-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-67bbabe0-6e1e-40ab-8aa9-fab2073b951b req-dfb5f22d-815f-406e-b672-2111638ae78e service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Refreshing instance network info cache due to event network-changed-aecee797-fb71-4cc0-be57-f8f389ee13c2. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:18:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-67bbabe0-6e1e-40ab-8aa9-fab2073b951b req-dfb5f22d-815f-406e-b672-2111638ae78e service nova] Acquiring lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:18:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-67bbabe0-6e1e-40ab-8aa9-fab2073b951b req-dfb5f22d-815f-406e-b672-2111638ae78e service nova] Acquired lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:18:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-67bbabe0-6e1e-40ab-8aa9-fab2073b951b req-dfb5f22d-815f-406e-b672-2111638ae78e service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Refreshing network info cache for port aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:18:51 user nova-compute[75813]: DEBUG nova.network.neutron [req-67bbabe0-6e1e-40ab-8aa9-fab2073b951b req-dfb5f22d-815f-406e-b672-2111638ae78e service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Updated VIF entry in instance network info cache for port aecee797-fb71-4cc0-be57-f8f389ee13c2. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:18:51 user nova-compute[75813]: DEBUG nova.network.neutron [req-67bbabe0-6e1e-40ab-8aa9-fab2073b951b req-dfb5f22d-815f-406e-b672-2111638ae78e service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Updating instance_info_cache with network_info: [{"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-67bbabe0-6e1e-40ab-8aa9-fab2073b951b req-dfb5f22d-815f-406e-b672-2111638ae78e service nova] Releasing lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:18:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "191fa449-c6c6-4096-94bb-df2225ad1ce2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:52 user nova-compute[75813]: INFO nova.compute.manager [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Terminating instance
Nov 15 13:18:52 user nova-compute[75813]: DEBUG nova.compute.manager [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-cd432cf2-5afc-44e7-97f9-2ad251b2a61e req-6e04dc7d-ec34-4828-81bf-a9f9d28e19a7 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received event network-changed-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-cd432cf2-5afc-44e7-97f9-2ad251b2a61e req-6e04dc7d-ec34-4828-81bf-a9f9d28e19a7 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Refreshing instance network info cache due to event network-changed-aecee797-fb71-4cc0-be57-f8f389ee13c2. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cd432cf2-5afc-44e7-97f9-2ad251b2a61e req-6e04dc7d-ec34-4828-81bf-a9f9d28e19a7 service nova] Acquiring lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cd432cf2-5afc-44e7-97f9-2ad251b2a61e req-6e04dc7d-ec34-4828-81bf-a9f9d28e19a7 service nova] Acquired lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:18:52 user nova-compute[75813]: DEBUG nova.network.neutron [req-cd432cf2-5afc-44e7-97f9-2ad251b2a61e req-6e04dc7d-ec34-4828-81bf-a9f9d28e19a7 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Refreshing network info cache for port aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG nova.network.neutron [req-cd432cf2-5afc-44e7-97f9-2ad251b2a61e req-6e04dc7d-ec34-4828-81bf-a9f9d28e19a7 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Updated VIF entry in instance network info cache for port aecee797-fb71-4cc0-be57-f8f389ee13c2. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG nova.network.neutron [req-cd432cf2-5afc-44e7-97f9-2ad251b2a61e req-6e04dc7d-ec34-4828-81bf-a9f9d28e19a7 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Updating instance_info_cache with network_info: [{"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cd432cf2-5afc-44e7-97f9-2ad251b2a61e req-6e04dc7d-ec34-4828-81bf-a9f9d28e19a7 service nova] Releasing lock "refresh_cache-191fa449-c6c6-4096-94bb-df2225ad1ce2" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:18:53 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Instance destroyed successfully.
Nov 15 13:18:53 user nova-compute[75813]: DEBUG nova.objects.instance [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'resources' on Instance uuid 191fa449-c6c6-4096-94bb-df2225ad1ce2 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1593581397',display_name='tempest-TestVolumeBootPattern-server-1593581397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1593581397',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVAQWHIq9cYMEzcyVYcUoyfR2jxd2gljn//pF8UzTbmKwL/Z5WpRY76WGV9mAg+N+3PLplBlRmOaiMT+tOytqHtvyAtP7F/jIKyI5SH5XjxLhIhN8ZWLbU2OF0/srpA==',key_name='tempest-TestVolumeBootPattern-1181310603',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:17:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-5wh4podh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:17:10Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=191fa449-c6c6-4096-94bb-df2225ad1ce2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "address": "fa:16:3e:b4:24:50", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecee797-fb", "ovs_interfaceid": "aecee797-fb71-4cc0-be57-f8f389ee13c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:24:50,bridge_name='br-int',has_traffic_filtering=True,id=aecee797-fb71-4cc0-be57-f8f389ee13c2,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecee797-fb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_vif [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:24:50,bridge_name='br-int',has_traffic_filtering=True,id=aecee797-fb71-4cc0-be57-f8f389ee13c2,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecee797-fb') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaecee797-fb, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a13c4fe7-b475-48a7-8a15-27a0a236297b) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:53 user nova-compute[75813]: INFO os_vif [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:24:50,bridge_name='br-int',has_traffic_filtering=True,id=aecee797-fb71-4cc0-be57-f8f389ee13c2,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecee797-fb')
Nov 15 13:18:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHvIhoSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:18:53 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81319ef-833b-4f1d-a3d5-ac6136fb3f9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:18:53 user nova-compute[75813]: No targets found.
Nov 15 13:18:53 user nova-compute[75813]: iSNS:
Nov 15 13:18:53 user nova-compute[75813]: No targets found.
Nov 15 13:18:53 user nova-compute[75813]: STATIC:
Nov 15 13:18:53 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7
Nov 15 13:18:53 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:18:53 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:18:53 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093
Nov 15 13:18:53 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:18:53 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:18:53 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540
Nov 15 13:18:53 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:18:53 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:18:53 user nova-compute[75813]: FIRMWARE:
Nov 15 13:18:53 user nova-compute[75813]: No targets found.
Nov 15 13:18:53 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:18:53 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:18:53 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dd5141-c31c-45c1-8525-f1e3645bec71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d276c749-8e40-41b6-8f31-450a0bb41f58]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:18:53 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:18:53 user nova-compute[75813]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:18:53 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:18:53 user nova-compute[75813]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 (non-flash)
Nov 15 13:18:53 user nova-compute[75813]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:18:53 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55504f9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad43188-a0b9-4015-b507-f48e719f2125]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ea56ef-35ce-43e5-9564-694c9a67d020]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a6fa3-fa4a-46e3-9521-07d6e1870b0a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b4db50-3f56-43fd-bb3f-ebf808bceea6]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a329e8f2-8382-4087-afda-a3b44332a6ad]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0721acb4-fee6-45e0-9bbf-2092e7813bbc]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540, portal: 172.16.0.220,3260]
Nov 15 13:18:53 user nova-compute[75813]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540, portal: 172.16.0.220,3260] successful.
Nov 15 13:18:53 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb45e05d-9b46-4752-8090-0ecddf826540 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01f5341-d3f3-46db-bd13-606a61ae0e73]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== disconnect_volume: return (355ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:18:53 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Deleting instance files /opt/stack/data/nova/instances/191fa449-c6c6-4096-94bb-df2225ad1ce2_del
Nov 15 13:18:53 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Deletion of /opt/stack/data/nova/instances/191fa449-c6c6-4096-94bb-df2225ad1ce2_del complete
Nov 15 13:18:53 user nova-compute[75813]: INFO nova.compute.manager [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 13:18:53 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:18:53 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:18:54 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Took 0.59 seconds to deallocate network for instance.
Nov 15 13:18:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-3be7c04d-cc83-426b-8a27-54f085870471 req-152db743-6ea8-4035-a8fa-5bbcb3f26d2b service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received event network-vif-deleted-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received event network-vif-unplugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] Acquiring lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] No waiting events found dispatching network-vif-unplugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received event network-vif-unplugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received event network-vif-plugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] Acquiring lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] No waiting events found dispatching network-vif-plugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:18:54 user nova-compute[75813]: WARNING nova.compute.manager [req-a8f818a6-dca9-4381-b9fd-26ec16f4ee93 req-635972ce-e603-47bb-92cb-775d0b0fe8d3 service nova] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Received unexpected event network-vif-plugged-aecee797-fb71-4cc0-be57-f8f389ee13c2 for instance with vm_state active and task_state deleting.
Nov 15 13:18:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:55 user nova-compute[75813]: INFO nova.compute.manager [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: 191fa449-c6c6-4096-94bb-df2225ad1ce2] Took 0.69 seconds to detach 1 volumes for instance.
Nov 15 13:18:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:18:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:18:55 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:18:55 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:18:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:55 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Deleted allocations for instance 191fa449-c6c6-4096-94bb-df2225ad1ce2
Nov 15 13:18:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-dba4f221-4c04-4787-b941-c2e25cb6686e tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "191fa449-c6c6-4096-94bb-df2225ad1ce2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.977s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:18:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:18:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:01 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:19:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:19:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:19:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:19:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca55ee20-1155-4312-8508-a223654cd615] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:19:01 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:19:01 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updating instance_info_cache with network_info: [{"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:19:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:19:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:19:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:19:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:19:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:19:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:19:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:04 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:19:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:04 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75813) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 13:19:05 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 13:19:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] There are 0 instances to clean {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 13:19:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:09 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:11 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:14 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:19:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:17 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:19:17 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8021MB free_disk=24.706336975097656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance df9506c4-4e3d-432e-9e36-c2308db670eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance c8711110-3a8f-4f80-b991-4061faaaa2d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 51af821e-6a11-406e-95f6-0cd4501a6c33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 55b865f3-afc6-4b3f-a7af-392dfd7b063d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing inventories for resource provider 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating ProviderTree inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing aggregate associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, aggregates: None {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 13:19:17 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing trait associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, traits: HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 13:19:18 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:19:18 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:19:18 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:19:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:19:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:19:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:19:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:19:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:19:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-6d0ea86c-883b-47de-b46a-bf52874c4146 req-0978c09f-e359-471a-8f21-8a5fb4120ba5 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-changed-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG nova.compute.manager [req-6d0ea86c-883b-47de-b46a-bf52874c4146 req-0978c09f-e359-471a-8f21-8a5fb4120ba5 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Refreshing instance network info cache due to event network-changed-9a8f8938-6aaf-4651-be3f-9b96c4ef331c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6d0ea86c-883b-47de-b46a-bf52874c4146 req-0978c09f-e359-471a-8f21-8a5fb4120ba5 service nova] Acquiring lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6d0ea86c-883b-47de-b46a-bf52874c4146 req-0978c09f-e359-471a-8f21-8a5fb4120ba5 service nova] Acquired lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG nova.network.neutron [req-6d0ea86c-883b-47de-b46a-bf52874c4146 req-0978c09f-e359-471a-8f21-8a5fb4120ba5 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Refreshing network info cache for port 9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:33 user nova-compute[75813]: INFO nova.compute.manager [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Terminating instance
Nov 15 13:19:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG nova.network.neutron [req-6d0ea86c-883b-47de-b46a-bf52874c4146 req-0978c09f-e359-471a-8f21-8a5fb4120ba5 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Updated VIF entry in instance network info cache for port 9a8f8938-6aaf-4651-be3f-9b96c4ef331c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG nova.network.neutron [req-6d0ea86c-883b-47de-b46a-bf52874c4146 req-0978c09f-e359-471a-8f21-8a5fb4120ba5 service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Updating instance_info_cache with network_info: [{"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-6d0ea86c-883b-47de-b46a-bf52874c4146 req-0978c09f-e359-471a-8f21-8a5fb4120ba5 service nova] Releasing lock "refresh_cache-df9506c4-4e3d-432e-9e36-c2308db670eb" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Instance destroyed successfully.
Nov 15 13:19:34 user nova-compute[75813]: DEBUG nova.objects.instance [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lazy-loading 'resources' on Instance uuid df9506c4-4e3d-432e-9e36-c2308db670eb {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:12:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1239040693',display_name='tempest-TestStampPattern-server-1239040693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1239040693',id=41,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLKrkLu7f9w3+U6cD1j5d4t/hb+GATdYey2Mtp5Sm2zl/kk0TYZnXEXQqeVbbwwqJDQaj0o7WXy4ErZdlp6eJTA23hMjmFtD1DfWfDHzibymmApmthDuNQCp3ogmew4qQ==',key_name='tempest-TestStampPattern-1022702423',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:12:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c994fd1a1654264a408318e33304679',ramdisk_id='',reservation_id='r-ramhahfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1055506233',owner_user_name='tempest-TestStampPattern-1055506233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:15:43Z,user_data=None,user_id='c260e661d4104e7888fdd3fc4257cc4d',uuid=df9506c4-4e3d-432e-9e36-c2308db670eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converting VIF {"id": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "address": "fa:16:3e:fd:2b:79", "network": {"id": "1e7845e6-6be7-4574-99e3-2f5156c30894", "bridge": "br-int", "label": "tempest-TestStampPattern-1276007714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c994fd1a1654264a408318e33304679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8f8938-6a", "ovs_interfaceid": "9a8f8938-6aaf-4651-be3f-9b96c4ef331c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:2b:79,bridge_name='br-int',has_traffic_filtering=True,id=9a8f8938-6aaf-4651-be3f-9b96c4ef331c,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8f8938-6a') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG os_vif [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:2b:79,bridge_name='br-int',has_traffic_filtering=True,id=9a8f8938-6aaf-4651-be3f-9b96c4ef331c,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8f8938-6a') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a8f8938-6a, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b048fe0f-2ea9-4bf0-92da-9fec90852e1c) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:19:34 user nova-compute[75813]: INFO os_vif [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:2b:79,bridge_name='br-int',has_traffic_filtering=True,id=9a8f8938-6aaf-4651-be3f-9b96c4ef331c,network=Network(1e7845e6-6be7-4574-99e3-2f5156c30894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8f8938-6a')
Nov 15 13:19:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Deleting instance files /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb_del
Nov 15 13:19:34 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Deletion of /opt/stack/data/nova/instances/df9506c4-4e3d-432e-9e36-c2308db670eb_del complete
Nov 15 13:19:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:34 user nova-compute[75813]: INFO nova.compute.manager [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 13:19:34 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:19:34 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:35 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Took 0.55 seconds to deallocate network for instance.
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-b4a822a2-5aa6-4a09-b63e-218e8c9d0f5c req-5b2ff2b1-cd2b-407a-acaa-8d4baa6333bd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-vif-deleted-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:35 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Deleted allocations for instance df9506c4-4e3d-432e-9e36-c2308db670eb
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-bfaba6c9-6aab-4401-90ca-5e898566ff28 tempest-TestStampPattern-1055506233 tempest-TestStampPattern-1055506233-project-member] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.868s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-vif-unplugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] No waiting events found dispatching network-vif-unplugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:35 user nova-compute[75813]: WARNING nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received unexpected event network-vif-unplugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c for instance with vm_state deleted and task_state None.
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] No waiting events found dispatching network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:35 user nova-compute[75813]: WARNING nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received unexpected event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c for instance with vm_state deleted and task_state None.
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] No waiting events found dispatching network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:35 user nova-compute[75813]: WARNING nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received unexpected event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c for instance with vm_state deleted and task_state None.
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] No waiting events found dispatching network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:35 user nova-compute[75813]: WARNING nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received unexpected event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c for instance with vm_state deleted and task_state None.
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-vif-unplugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] No waiting events found dispatching network-vif-unplugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:35 user nova-compute[75813]: WARNING nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received unexpected event network-vif-unplugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c for instance with vm_state deleted and task_state None.
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Acquiring lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] Lock "df9506c4-4e3d-432e-9e36-c2308db670eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] No waiting events found dispatching network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:35 user nova-compute[75813]: WARNING nova.compute.manager [req-77d18b10-4d4c-4141-bb59-e1b80b26cd64 req-a2c09acb-d62e-4bd6-9194-b290da913ebd service nova] [instance: df9506c4-4e3d-432e-9e36-c2308db670eb] Received unexpected event network-vif-plugged-9a8f8938-6aaf-4651-be3f-9b96c4ef331c for instance with vm_state deleted and task_state None.
Nov 15 13:19:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:19:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:19:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:19:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:19:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:19:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-cc59bf11-94ca-4a42-a529-df9beef2a66f req-5938878f-64d1-4fc6-bf2d-38b0933f4a5e service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received event network-changed-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-cc59bf11-94ca-4a42-a529-df9beef2a66f req-5938878f-64d1-4fc6-bf2d-38b0933f4a5e service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Refreshing instance network info cache due to event network-changed-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cc59bf11-94ca-4a42-a529-df9beef2a66f req-5938878f-64d1-4fc6-bf2d-38b0933f4a5e service nova] Acquiring lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cc59bf11-94ca-4a42-a529-df9beef2a66f req-5938878f-64d1-4fc6-bf2d-38b0933f4a5e service nova] Acquired lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-cc59bf11-94ca-4a42-a529-df9beef2a66f req-5938878f-64d1-4fc6-bf2d-38b0933f4a5e service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Refreshing network info cache for port ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "c8711110-3a8f-4f80-b991-4061faaaa2d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:48 user nova-compute[75813]: INFO nova.compute.manager [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Terminating instance
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-f383ed86-049b-4140-b05d-c91ef7452690 req-a3f80c2b-99c9-434f-a401-c380cf42fea0 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received event network-vif-unplugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f383ed86-049b-4140-b05d-c91ef7452690 req-a3f80c2b-99c9-434f-a401-c380cf42fea0 service nova] Acquiring lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f383ed86-049b-4140-b05d-c91ef7452690 req-a3f80c2b-99c9-434f-a401-c380cf42fea0 service nova] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-f383ed86-049b-4140-b05d-c91ef7452690 req-a3f80c2b-99c9-434f-a401-c380cf42fea0 service nova] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-f383ed86-049b-4140-b05d-c91ef7452690 req-a3f80c2b-99c9-434f-a401-c380cf42fea0 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] No waiting events found dispatching network-vif-unplugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.compute.manager [req-f383ed86-049b-4140-b05d-c91ef7452690 req-a3f80c2b-99c9-434f-a401-c380cf42fea0 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received event network-vif-unplugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-cc59bf11-94ca-4a42-a529-df9beef2a66f req-5938878f-64d1-4fc6-bf2d-38b0933f4a5e service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Updated VIF entry in instance network info cache for port ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.network.neutron [req-cc59bf11-94ca-4a42-a529-df9beef2a66f req-5938878f-64d1-4fc6-bf2d-38b0933f4a5e service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Updating instance_info_cache with network_info: [{"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cc59bf11-94ca-4a42-a529-df9beef2a66f req-5938878f-64d1-4fc6-bf2d-38b0933f4a5e service nova] Releasing lock "refresh_cache-c8711110-3a8f-4f80-b991-4061faaaa2d8" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:19:48 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Instance destroyed successfully.
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.objects.instance [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lazy-loading 'resources' on Instance uuid c8711110-3a8f-4f80-b991-4061faaaa2d8 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1138692525',display_name='tempest-TestVolumeBootPattern-server-1138692525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1138692525',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVAQWHIq9cYMEzcyVYcUoyfR2jxd2gljn//pF8UzTbmKwL/Z5WpRY76WGV9mAg+N+3PLplBlRmOaiMT+tOytqHtvyAtP7F/jIKyI5SH5XjxLhIhN8ZWLbU2OF0/srpA==',key_name='tempest-TestVolumeBootPattern-1181310603',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:15:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63086918b1c84a608c4a5aebf968eab5',ramdisk_id='',reservation_id='r-zxbydrfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-678819035',owner_user_name='tempest-TestVolumeBootPattern-678819035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:15:13Z,user_data=None,user_id='3bc41f21cddc40e7a287b6f809233a65',uuid=c8711110-3a8f-4f80-b991-4061faaaa2d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converting VIF {"id": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "address": "fa:16:3e:3e:62:11", "network": {"id": "bd4f04ee-b096-4fc9-8939-65772b141277", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-348165725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63086918b1c84a608c4a5aebf968eab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb2cc47-ae", "ovs_interfaceid": "ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:62:11,bridge_name='br-int',has_traffic_filtering=True,id=ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb2cc47-ae') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG os_vif [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:62:11,bridge_name='br-int',has_traffic_filtering=True,id=ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb2cc47-ae') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddb2cc47-ae, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f08b704-816b-4378-94ca-ae5d6d10e025) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:48 user nova-compute[75813]: INFO os_vif [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:62:11,bridge_name='br-int',has_traffic_filtering=True,id=ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c,network=Network(bd4f04ee-b096-4fc9-8939-65772b141277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb2cc47-ae')
Nov 15 13:19:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTXrpRIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:19:48 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:19:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:19:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c8cf40-6bed-40f0-8d38-87d60391b2aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:19:49 user nova-compute[75813]: No targets found.
Nov 15 13:19:49 user nova-compute[75813]: iSNS:
Nov 15 13:19:49 user nova-compute[75813]: No targets found.
Nov 15 13:19:49 user nova-compute[75813]: STATIC:
Nov 15 13:19:49 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7
Nov 15 13:19:49 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:19:49 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:19:49 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093
Nov 15 13:19:49 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:19:49 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:19:49 user nova-compute[75813]: FIRMWARE:
Nov 15 13:19:49 user nova-compute[75813]: No targets found.
Nov 15 13:19:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:19:49 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:19:49 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6875faf-9a12-465d-9f6e-a8e65a1f00b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e21e30-251f-4151-95d2-50b24f375b75]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:19:49 user nova-compute[75813]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:19:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 (non-flash)
Nov 15 13:19:49 user nova-compute[75813]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:19:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555035eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7'): ({'sde'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Removing single pathed devices sde {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa8e5cb-29d8-42b5-aa3c-3658853866e7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb3cbbb-b15c-487d-9457-de7b9cb634e6]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Flushing IO for device /dev/sde {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d67ea5-5d2c-49bb-a25b-23352ba4148a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4532fc-33bb-4857-8a62-9168293615ae]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] SCSI volumes sde have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a988d196', '/dev/disk/by-id/scsi-1SCST_BIOa988d196-ae919d0d0dabba89', '/dev/disk/by-id/scsi-26165393139643064') {{(pid=87167) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad27c25-d6e6-4ab7-8c33-8a9b1e797243]: (4, None) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[377d223e-8444-461b-aa39-8ba4e7c58c30]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d07bfb-c5dd-425b-9983-30b81b1eab82]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260]
Nov 15 13:19:49 user nova-compute[75813]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7, portal: 172.16.0.220,3260] successful.
Nov 15 13:19:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58122a0b-746d-4f27-8699-2e20361443c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc41f48-7602-40a9-94d9-201374f331f0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] <== disconnect_volume: return (331ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:19:49 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Deleting instance files /opt/stack/data/nova/instances/c8711110-3a8f-4f80-b991-4061faaaa2d8_del
Nov 15 13:19:49 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Deletion of /opt/stack/data/nova/instances/c8711110-3a8f-4f80-b991-4061faaaa2d8_del complete
Nov 15 13:19:49 user nova-compute[75813]: INFO nova.compute.manager [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 15 13:19:49 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:19:49 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:19:49 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Took 0.42 seconds to deallocate network for instance.
Nov 15 13:19:50 user nova-compute[75813]: INFO nova.compute.manager [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Took 0.69 seconds to detach 1 volumes for instance.
Nov 15 13:19:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-e49a4f63-3754-4fce-8f40-245fedb3db58 req-fe2f6f95-e5a8-4763-9056-3085d61e11f0 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received event network-vif-plugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e49a4f63-3754-4fce-8f40-245fedb3db58 req-fe2f6f95-e5a8-4763-9056-3085d61e11f0 service nova] Acquiring lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e49a4f63-3754-4fce-8f40-245fedb3db58 req-fe2f6f95-e5a8-4763-9056-3085d61e11f0 service nova] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e49a4f63-3754-4fce-8f40-245fedb3db58 req-fe2f6f95-e5a8-4763-9056-3085d61e11f0 service nova] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-e49a4f63-3754-4fce-8f40-245fedb3db58 req-fe2f6f95-e5a8-4763-9056-3085d61e11f0 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] No waiting events found dispatching network-vif-plugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:50 user nova-compute[75813]: WARNING nova.compute.manager [req-e49a4f63-3754-4fce-8f40-245fedb3db58 req-fe2f6f95-e5a8-4763-9056-3085d61e11f0 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received unexpected event network-vif-plugged-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c for instance with vm_state deleted and task_state None.
Nov 15 13:19:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-e49a4f63-3754-4fce-8f40-245fedb3db58 req-fe2f6f95-e5a8-4763-9056-3085d61e11f0 service nova] [instance: c8711110-3a8f-4f80-b991-4061faaaa2d8] Received event network-vif-deleted-ddb2cc47-ae18-4aa4-9758-0a371ad9cd7c {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:50 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:19:50 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:19:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:50 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Deleted allocations for instance c8711110-3a8f-4f80-b991-4061faaaa2d8
Nov 15 13:19:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-48a525c7-b6c2-4eed-8583-4487393a8a3a tempest-TestVolumeBootPattern-678819035 tempest-TestVolumeBootPattern-678819035-project-member] Lock "c8711110-3a8f-4f80-b991-4061faaaa2d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.706s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG nova.objects.instance [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'flavor' on Instance uuid 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:54 user nova-compute[75813]: INFO nova.compute.manager [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Attaching volume fda1370c-2db9-4039-9578-4398cfd68b48 to /dev/vdb
Nov 15 13:19:54 user nova-compute[75813]: DEBUG os_brick.utils [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f88d69-c2c9-48e0-9fb9-e66323ae65d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e582bb83-ccc8-4a29-a08d-951e70d4320a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef95489f-afbb-400d-90f8-414b31c4d6d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[645d85d9-1808-4921-80fc-ba696bc68948]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:19:54 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:19:54 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2345b9f-8336-48b8-8e5b-db966d061259]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG os_brick.utils [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:19:54 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updating existing volume attachment record: 254ebd0c-ce29-4317-b644-d189dd4ef759 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:19:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:55 user nova-compute[75813]: INFO nova.compute.manager [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Terminating instance
Nov 15 13:19:55 user nova-compute[75813]: DEBUG nova.compute.manager [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-82540ecf-5c75-4dbc-b5f6-73c9c26c2376 req-ff8e08f7-5056-4e43-8ca5-6d8756febe1a service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received event network-vif-unplugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-82540ecf-5c75-4dbc-b5f6-73c9c26c2376 req-ff8e08f7-5056-4e43-8ca5-6d8756febe1a service nova] Acquiring lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-82540ecf-5c75-4dbc-b5f6-73c9c26c2376 req-ff8e08f7-5056-4e43-8ca5-6d8756febe1a service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-82540ecf-5c75-4dbc-b5f6-73c9c26c2376 req-ff8e08f7-5056-4e43-8ca5-6d8756febe1a service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-82540ecf-5c75-4dbc-b5f6-73c9c26c2376 req-ff8e08f7-5056-4e43-8ca5-6d8756febe1a service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] No waiting events found dispatching network-vif-unplugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-82540ecf-5c75-4dbc-b5f6-73c9c26c2376 req-ff8e08f7-5056-4e43-8ca5-6d8756febe1a service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received event network-vif-unplugged-d0b85a23-2241-47fb-8c74-aea684638bb1 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Instance destroyed successfully.
Nov 15 13:19:56 user nova-compute[75813]: DEBUG nova.objects.instance [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lazy-loading 'resources' on Instance uuid 55b865f3-afc6-4b3f-a7af-392dfd7b063d {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1956988430',display_name='tempest-VolumesActionsTest-instance-1956988430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1956988430',id=47,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7e0c39eb5ff4a26a35c7e07d0ed66f5',ramdisk_id='',reservation_id='r-c5ye00s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1071662127',owner_user_name='tempest-VolumesActionsTest-1071662127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:18:13Z,user_data=None,user_id='172f130186f04b45a24337416d54780a',uuid=55b865f3-afc6-4b3f-a7af-392dfd7b063d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0b85a23-2241-47fb-8c74-aea684638bb1", "address": "fa:16:3e:ef:f1:71", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b85a23-22", "ovs_interfaceid": "d0b85a23-2241-47fb-8c74-aea684638bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converting VIF {"id": "d0b85a23-2241-47fb-8c74-aea684638bb1", "address": "fa:16:3e:ef:f1:71", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b85a23-22", "ovs_interfaceid": "d0b85a23-2241-47fb-8c74-aea684638bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:71,bridge_name='br-int',has_traffic_filtering=True,id=d0b85a23-2241-47fb-8c74-aea684638bb1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b85a23-22') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG os_vif [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:71,bridge_name='br-int',has_traffic_filtering=True,id=d0b85a23-2241-47fb-8c74-aea684638bb1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b85a23-22') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0b85a23-22, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ffdb39a-c97f-475e-bce7-b6e16267a992) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:56 user nova-compute[75813]: INFO os_vif [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:f1:71,bridge_name='br-int',has_traffic_filtering=True,id=d0b85a23-2241-47fb-8c74-aea684638bb1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b85a23-22')
Nov 15 13:19:56 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Deleting instance files /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d_del
Nov 15 13:19:56 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Deletion of /opt/stack/data/nova/instances/55b865f3-afc6-4b3f-a7af-392dfd7b063d_del complete
Nov 15 13:19:56 user nova-compute[75813]: INFO nova.compute.manager [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 15 13:19:56 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:19:56 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:19:57 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Took 0.61 seconds to deallocate network for instance.
Nov 15 13:19:57 user nova-compute[75813]: DEBUG nova.compute.manager [req-570d9496-0c12-4982-a5e1-a5bd7985a8a9 req-23800076-6669-4eca-9892-c02e50c75e8f service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received event network-vif-deleted-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:19:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:57 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Deleted allocations for instance 55b865f3-afc6-4b3f-a7af-392dfd7b063d
Nov 15 13:19:57 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1325e1e7-e325-4290-9ab6-d06012e60a03 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.735s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Acquiring lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] No waiting events found dispatching network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:58 user nova-compute[75813]: WARNING nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received unexpected event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 for instance with vm_state deleted and task_state None.
Nov 15 13:19:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Acquiring lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] No waiting events found dispatching network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:58 user nova-compute[75813]: WARNING nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received unexpected event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 for instance with vm_state deleted and task_state None.
Nov 15 13:19:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Acquiring lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] No waiting events found dispatching network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:58 user nova-compute[75813]: WARNING nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received unexpected event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 for instance with vm_state deleted and task_state None.
Nov 15 13:19:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received event network-vif-unplugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Acquiring lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] No waiting events found dispatching network-vif-unplugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:58 user nova-compute[75813]: WARNING nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received unexpected event network-vif-unplugged-d0b85a23-2241-47fb-8c74-aea684638bb1 for instance with vm_state deleted and task_state None.
Nov 15 13:19:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Acquiring lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] Lock "55b865f3-afc6-4b3f-a7af-392dfd7b063d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:19:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] No waiting events found dispatching network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:19:58 user nova-compute[75813]: WARNING nova.compute.manager [req-50a9ebb0-c354-4be5-8644-419ba3b59bc4 req-72b71d32-0408-458d-9dbb-b0e03b82b175 service nova] [instance: 55b865f3-afc6-4b3f-a7af-392dfd7b063d] Received unexpected event network-vif-plugged-d0b85a23-2241-47fb-8c74-aea684638bb1 for instance with vm_state deleted and task_state None.
Nov 15 13:19:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaXduMvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:19:59 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:19:59 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:19:59 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d13e76-f4f9-4972-ba35-d0391522839c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:19:59 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df1e8a6-d6d0-4907-9941-836062532ea7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48] added
Nov 15 13:19:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2692836-3a11-485c-a22a-db565064bd8e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2258fd-e390-47c6-b435-bda1e3bef984]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HaXduMvc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HaXduMvc" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c722b201-6189-4a9b-9249-81b905c68836]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HaXduMvc'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[08472a80-25e7-4ce0-b14c-8b27f23dbf3e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eca3212-2974-4d66-8504-6839632bcb60]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:19:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:19:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6603a7-8850-4b57-abfa-600bbc28360d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48, portal: 172.16.0.220,3260]
Nov 15 13:19:59 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48, portal: 172.16.0.220,3260] successful.
Nov 15 13:19:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc2bd59-6acc-49d8-ba77-5d50e0ff8fca]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce66c3e-f84e-4e26-a1e4-88a6474c75e6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:19:59 user nova-compute[75813]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 (non-flash)
Nov 15 13:19:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:19:59 user nova-compute[75813]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 (non-flash)
Nov 15 13:19:59 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a19e34-5a30-4851-930c-13ddc784a01f]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:19:59 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaXduMvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:20:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:20:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23636623233376461', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:20:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636623233376461', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:20:00 user nova-compute[75813]: DEBUG nova.objects.instance [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'flavor' on Instance uuid 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:20:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:20:00 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:20:00 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:20:00 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:20:00 user nova-compute[75813]:   <serial>fda1370c-2db9-4039-9578-4398cfd68b48</serial>
Nov 15 13:20:00 user nova-compute[75813]: </disk>
Nov 15 13:20:00 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:20:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:20:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:20:01 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] No VIF found with MAC fa:16:3e:8f:bc:d5, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:20:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-812e21ad-1ff7-48e7-b772-0635c8fb2abf tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.798s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-83b71754-9645-4425-b63b-6fde3d503f83 req-d77a5f41-0740-49a0-963d-7ee29cd565ca service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-changed-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-83b71754-9645-4425-b63b-6fde3d503f83 req-d77a5f41-0740-49a0-963d-7ee29cd565ca service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Refreshing instance network info cache due to event network-changed-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:20:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83b71754-9645-4425-b63b-6fde3d503f83 req-d77a5f41-0740-49a0-963d-7ee29cd565ca service nova] Acquiring lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:20:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83b71754-9645-4425-b63b-6fde3d503f83 req-d77a5f41-0740-49a0-963d-7ee29cd565ca service nova] Acquired lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:20:03 user nova-compute[75813]: DEBUG nova.network.neutron [req-83b71754-9645-4425-b63b-6fde3d503f83 req-d77a5f41-0740-49a0-963d-7ee29cd565ca service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Refreshing network info cache for port 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:20:04 user nova-compute[75813]: DEBUG nova.network.neutron [req-83b71754-9645-4425-b63b-6fde3d503f83 req-d77a5f41-0740-49a0-963d-7ee29cd565ca service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updated VIF entry in instance network info cache for port 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:20:04 user nova-compute[75813]: DEBUG nova.network.neutron [req-83b71754-9645-4425-b63b-6fde3d503f83 req-d77a5f41-0740-49a0-963d-7ee29cd565ca service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updating instance_info_cache with network_info: [{"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:20:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-83b71754-9645-4425-b63b-6fde3d503f83 req-d77a5f41-0740-49a0-963d-7ee29cd565ca service nova] Releasing lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:20:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-dad7a2ca-faec-45a2-ad99-abff47808686 req-e081be7c-744b-477a-b628-ca4ed6cf802b service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-changed-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:05 user nova-compute[75813]: DEBUG nova.compute.manager [req-dad7a2ca-faec-45a2-ad99-abff47808686 req-e081be7c-744b-477a-b628-ca4ed6cf802b service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Refreshing instance network info cache due to event network-changed-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:20:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dad7a2ca-faec-45a2-ad99-abff47808686 req-e081be7c-744b-477a-b628-ca4ed6cf802b service nova] Acquiring lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:20:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dad7a2ca-faec-45a2-ad99-abff47808686 req-e081be7c-744b-477a-b628-ca4ed6cf802b service nova] Acquired lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:20:05 user nova-compute[75813]: DEBUG nova.network.neutron [req-dad7a2ca-faec-45a2-ad99-abff47808686 req-e081be7c-744b-477a-b628-ca4ed6cf802b service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Refreshing network info cache for port 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG nova.network.neutron [req-dad7a2ca-faec-45a2-ad99-abff47808686 req-e081be7c-744b-477a-b628-ca4ed6cf802b service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updated VIF entry in instance network info cache for port 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG nova.network.neutron [req-dad7a2ca-faec-45a2-ad99-abff47808686 req-e081be7c-744b-477a-b628-ca4ed6cf802b service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updating instance_info_cache with network_info: [{"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-dad7a2ca-faec-45a2-ad99-abff47808686 req-e081be7c-744b-477a-b628-ca4ed6cf802b service nova] Releasing lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:06 user nova-compute[75813]: INFO nova.compute.manager [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Rebooting instance
Nov 15 13:20:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquired lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:20:06 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:20:07 user nova-compute[75813]: INFO nova.compute.manager [None req-5871220a-4a71-4a31-8f58-9aca30df7490 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Unrescuing
Nov 15 13:20:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5871220a-4a71-4a31-8f58-9aca30df7490 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5871220a-4a71-4a31-8f58-9aca30df7490 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquired lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-5871220a-4a71-4a31-8f58-9aca30df7490 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updating instance_info_cache with network_info: [{"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Releasing lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Updating instance_info_cache with network_info: [{"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-eaff87f2-d74c-4e1b-b471-33bd1aeeed34" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-5871220a-4a71-4a31-8f58-9aca30df7490 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updating instance_info_cache with network_info: [{"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-5871220a-4a71-4a31-8f58-9aca30df7490 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Releasing lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:20:07 user nova-compute[75813]: DEBUG nova.objects.instance [None req-5871220a-4a71-4a31-8f58-9aca30df7490 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'flavor' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:20:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:20:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:20:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-df8bc7fe-93f4-408d-9308-eee03c76c92c req-28b89575-bc03-4ffc-99f6-ae09821bcb5e service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-df8bc7fe-93f4-408d-9308-eee03c76c92c req-28b89575-bc03-4ffc-99f6-ae09821bcb5e service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-df8bc7fe-93f4-408d-9308-eee03c76c92c req-28b89575-bc03-4ffc-99f6-ae09821bcb5e service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:08 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-df8bc7fe-93f4-408d-9308-eee03c76c92c req-28b89575-bc03-4ffc-99f6-ae09821bcb5e service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:08 user nova-compute[75813]: DEBUG nova.compute.manager [req-df8bc7fe-93f4-408d-9308-eee03c76c92c req-28b89575-bc03-4ffc-99f6-ae09821bcb5e service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:20:08 user nova-compute[75813]: WARNING nova.compute.manager [req-df8bc7fe-93f4-408d-9308-eee03c76c92c req-28b89575-bc03-4ffc-99f6-ae09821bcb5e service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:20:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:08 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Instance destroyed successfully.
Nov 15 13:20:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-349fefe2-00e0-440e-b122-ced71aa4353a req-60bd682d-7db8-456a-b8fb-a3e2fbcc1db3 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-vif-unplugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-349fefe2-00e0-440e-b122-ced71aa4353a req-60bd682d-7db8-456a-b8fb-a3e2fbcc1db3 service nova] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-349fefe2-00e0-440e-b122-ced71aa4353a req-60bd682d-7db8-456a-b8fb-a3e2fbcc1db3 service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-349fefe2-00e0-440e-b122-ced71aa4353a req-60bd682d-7db8-456a-b8fb-a3e2fbcc1db3 service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-349fefe2-00e0-440e-b122-ced71aa4353a req-60bd682d-7db8-456a-b8fb-a3e2fbcc1db3 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] No waiting events found dispatching network-vif-unplugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:20:10 user nova-compute[75813]: WARNING nova.compute.manager [req-349fefe2-00e0-440e-b122-ced71aa4353a req-60bd682d-7db8-456a-b8fb-a3e2fbcc1db3 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received unexpected event network-vif-unplugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f for instance with vm_state active and task_state reboot_started.
Nov 15 13:20:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:20:10 user nova-compute[75813]: WARNING nova.compute.manager [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:20:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:20:10 user nova-compute[75813]: WARNING nova.compute.manager [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:20:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:10 user nova-compute[75813]: DEBUG nova.compute.manager [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:20:10 user nova-compute[75813]: WARNING nova.compute.manager [req-4f79b426-4061-471b-895e-868b54c2e16c req-97b2539d-07cb-4cc8-970c-1e2a939b5212 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 13:20:10 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Instance shutdown successfully.
Nov 15 13:20:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-5871220a-4a71-4a31-8f58-9aca30df7490 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] No waiting events found dispatching network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:20:12 user nova-compute[75813]: WARNING nova.compute.manager [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received unexpected event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f for instance with vm_state active and task_state reboot_started.
Nov 15 13:20:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG nova.compute.manager [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] No waiting events found dispatching network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:20:12 user nova-compute[75813]: WARNING nova.compute.manager [req-38490d1e-e2dd-4454-8b6c-24f3dd25c883 req-cf1733c3-ec72-4ae7-b39c-b6fe97c41e63 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received unexpected event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f for instance with vm_state active and task_state reboot_started.
Nov 15 13:20:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:13 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:20:14 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Instance running successfully.
Nov 15 13:20:14 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Instance soft rebooted successfully.
Nov 15 13:20:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:20:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2f7df6ac-c932-4f7b-ae98-a82a56b4f438 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.682s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-e4ebf87c-bb54-4d34-a5fe-b633a4dc320a req-ae3c4775-f801-4cd3-99a3-d7654577b41a service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e4ebf87c-bb54-4d34-a5fe-b633a4dc320a req-ae3c4775-f801-4cd3-99a3-d7654577b41a service nova] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e4ebf87c-bb54-4d34-a5fe-b633a4dc320a req-ae3c4775-f801-4cd3-99a3-d7654577b41a service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e4ebf87c-bb54-4d34-a5fe-b633a4dc320a req-ae3c4775-f801-4cd3-99a3-d7654577b41a service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-e4ebf87c-bb54-4d34-a5fe-b633a4dc320a req-ae3c4775-f801-4cd3-99a3-d7654577b41a service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] No waiting events found dispatching network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:20:14 user nova-compute[75813]: WARNING nova.compute.manager [req-e4ebf87c-bb54-4d34-a5fe-b633a4dc320a req-ae3c4775-f801-4cd3-99a3-d7654577b41a service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received unexpected event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f for instance with vm_state active and task_state None.
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:15 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:20:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:20:17 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:20:17 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:20:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8617MB free_disk=24.848636627197266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 51af821e-6a11-406e-95f6-0cd4501a6c33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:20:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:47 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:20:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:47 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:20:47 user nova-compute[75813]: INFO nova.compute.claims [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Claim successful on node user
Nov 15 13:20:48 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:20:48 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:20:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG nova.policy [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '172f130186f04b45a24337416d54780a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e0c39eb5ff4a26a35c7e07d0ed66f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:20:48 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Creating image(s)
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "/opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "/opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "/opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk 1073741824" returned: 0 in 0.088s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Successfully created port: 4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Cannot resize image /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Ensure instance console log exists: /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Successfully updated port: 4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "refresh_cache-a74dd695-4d4a-46e7-9897-4d3ffac83ba6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquired lock "refresh_cache-a74dd695-4d4a-46e7-9897-4d3ffac83ba6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:20:49 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-eddd23eb-cfd0-4e2a-b535-bfba7657aa08 req-219a4465-9b6f-4308-acef-de130c411e10 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Received event network-changed-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-eddd23eb-cfd0-4e2a-b535-bfba7657aa08 req-219a4465-9b6f-4308-acef-de130c411e10 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Refreshing instance network info cache due to event network-changed-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-eddd23eb-cfd0-4e2a-b535-bfba7657aa08 req-219a4465-9b6f-4308-acef-de130c411e10 service nova] Acquiring lock "refresh_cache-a74dd695-4d4a-46e7-9897-4d3ffac83ba6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.network.neutron [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Updating instance_info_cache with network_info: [{"id": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "address": "fa:16:3e:9a:a6:7e", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66b4a2-28", "ovs_interfaceid": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Releasing lock "refresh_cache-a74dd695-4d4a-46e7-9897-4d3ffac83ba6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Instance network_info: |[{"id": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "address": "fa:16:3e:9a:a6:7e", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66b4a2-28", "ovs_interfaceid": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-eddd23eb-cfd0-4e2a-b535-bfba7657aa08 req-219a4465-9b6f-4308-acef-de130c411e10 service nova] Acquired lock "refresh_cache-a74dd695-4d4a-46e7-9897-4d3ffac83ba6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-eddd23eb-cfd0-4e2a-b535-bfba7657aa08 req-219a4465-9b6f-4308-acef-de130c411e10 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Refreshing network info cache for port 4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Start _get_guest_xml network_info=[{"id": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "address": "fa:16:3e:9a:a6:7e", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66b4a2-28", "ovs_interfaceid": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:20:50 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:20:50 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-835925000',display_name='tempest-VolumesActionsTest-instance-835925000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-835925000',id=48,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7e0c39eb5ff4a26a35c7e07d0ed66f5',ramdisk_id='',reservation_id='r-2dkqvboi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1071662127',owner_user_name='tempest-VolumesActionsTest-1071662127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:20:48Z,user_data=None,user_id='172f130186f04b45a24337416d54780a',uuid=a74dd695-4d4a-46e7-9897-4d3ffac83ba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "address": "fa:16:3e:9a:a6:7e", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66b4a2-28", "ovs_interfaceid": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converting VIF {"id": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "address": "fa:16:3e:9a:a6:7e", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66b4a2-28", "ovs_interfaceid": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a6:7e,bridge_name='br-int',has_traffic_filtering=True,id=4b66b4a2-28a6-4dc3-9389-39e427f8b3a1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66b4a2-28') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lazy-loading 'pci_devices' on Instance uuid a74dd695-4d4a-46e7-9897-4d3ffac83ba6 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:20:50 user nova-compute[75813]:   <uuid>a74dd695-4d4a-46e7-9897-4d3ffac83ba6</uuid>
Nov 15 13:20:50 user nova-compute[75813]:   <name>instance-00000030</name>
Nov 15 13:20:50 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:20:50 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:20:50 user nova-compute[75813]:   <metadata>
Nov 15 13:20:50 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:20:50 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:20:50 user nova-compute[75813]:       <nova:name>tempest-VolumesActionsTest-instance-835925000</nova:name>
Nov 15 13:20:50 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:20:50</nova:creationTime>
Nov 15 13:20:50 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:20:50 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:20:50 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:20:50 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:20:50 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:20:50 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:20:50 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:20:50 user nova-compute[75813]:       <nova:owner>
Nov 15 13:20:50 user nova-compute[75813]:         <nova:user uuid="172f130186f04b45a24337416d54780a">tempest-VolumesActionsTest-1071662127-project-member</nova:user>
Nov 15 13:20:50 user nova-compute[75813]:         <nova:project uuid="a7e0c39eb5ff4a26a35c7e07d0ed66f5">tempest-VolumesActionsTest-1071662127</nova:project>
Nov 15 13:20:50 user nova-compute[75813]:       </nova:owner>
Nov 15 13:20:50 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:20:50 user nova-compute[75813]:       <nova:ports>
Nov 15 13:20:50 user nova-compute[75813]:         <nova:port uuid="4b66b4a2-28a6-4dc3-9389-39e427f8b3a1">
Nov 15 13:20:50 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 13:20:50 user nova-compute[75813]:         </nova:port>
Nov 15 13:20:50 user nova-compute[75813]:       </nova:ports>
Nov 15 13:20:50 user nova-compute[75813]:     </nova:instance>
Nov 15 13:20:50 user nova-compute[75813]:   </metadata>
Nov 15 13:20:50 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:20:50 user nova-compute[75813]:     <system>
Nov 15 13:20:50 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:20:50 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:20:50 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:20:50 user nova-compute[75813]:       <entry name="serial">a74dd695-4d4a-46e7-9897-4d3ffac83ba6</entry>
Nov 15 13:20:50 user nova-compute[75813]:       <entry name="uuid">a74dd695-4d4a-46e7-9897-4d3ffac83ba6</entry>
Nov 15 13:20:50 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:20:50 user nova-compute[75813]:     </system>
Nov 15 13:20:50 user nova-compute[75813]:   </sysinfo>
Nov 15 13:20:50 user nova-compute[75813]:   <os>
Nov 15 13:20:50 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:20:50 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:20:50 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:20:50 user nova-compute[75813]:   </os>
Nov 15 13:20:50 user nova-compute[75813]:   <features>
Nov 15 13:20:50 user nova-compute[75813]:     <acpi/>
Nov 15 13:20:50 user nova-compute[75813]:     <apic/>
Nov 15 13:20:50 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:20:50 user nova-compute[75813]:   </features>
Nov 15 13:20:50 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:20:50 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:20:50 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:20:50 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:20:50 user nova-compute[75813]:   </clock>
Nov 15 13:20:50 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:20:50 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:20:50 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:20:50 user nova-compute[75813]:   </cpu>
Nov 15 13:20:50 user nova-compute[75813]:   <devices>
Nov 15 13:20:50 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:20:50 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:20:50 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk"/>
Nov 15 13:20:50 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:20:50 user nova-compute[75813]:     </disk>
Nov 15 13:20:50 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:20:50 user nova-compute[75813]:       <mac address="fa:16:3e:9a:a6:7e"/>
Nov 15 13:20:50 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:20:50 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:20:50 user nova-compute[75813]:       <target dev="tap4b66b4a2-28"/>
Nov 15 13:20:50 user nova-compute[75813]:     </interface>
Nov 15 13:20:50 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:20:50 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/console.log" append="off"/>
Nov 15 13:20:50 user nova-compute[75813]:     </serial>
Nov 15 13:20:50 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:20:50 user nova-compute[75813]:     <video>
Nov 15 13:20:50 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:20:50 user nova-compute[75813]:     </video>
Nov 15 13:20:50 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:20:50 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:20:50 user nova-compute[75813]:     </rng>
Nov 15 13:20:50 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:20:50 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:20:50 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:20:50 user nova-compute[75813]:     </memballoon>
Nov 15 13:20:50 user nova-compute[75813]:   </devices>
Nov 15 13:20:50 user nova-compute[75813]: </domain>
Nov 15 13:20:50 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-835925000',display_name='tempest-VolumesActionsTest-instance-835925000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-835925000',id=48,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7e0c39eb5ff4a26a35c7e07d0ed66f5',ramdisk_id='',reservation_id='r-2dkqvboi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1071662127',owner_user_name='tempest-VolumesActionsTest-1071662127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:20:48Z,user_data=None,user_id='172f130186f04b45a24337416d54780a',uuid=a74dd695-4d4a-46e7-9897-4d3ffac83ba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "address": "fa:16:3e:9a:a6:7e", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66b4a2-28", "ovs_interfaceid": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converting VIF {"id": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "address": "fa:16:3e:9a:a6:7e", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66b4a2-28", "ovs_interfaceid": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a6:7e,bridge_name='br-int',has_traffic_filtering=True,id=4b66b4a2-28a6-4dc3-9389-39e427f8b3a1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66b4a2-28') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG os_vif [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a6:7e,bridge_name='br-int',has_traffic_filtering=True,id=4b66b4a2-28a6-4dc3-9389-39e427f8b3a1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66b4a2-28') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2c06dad-56af-5f36-8584-5e687ba64a01', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b66b4a2-28, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b66b4a2-28, col_values=(('qos', UUID('7a4d762c-764f-4eb6-8650-be633590c5f9')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b66b4a2-28, col_values=(('external_ids', {'iface-id': '4b66b4a2-28a6-4dc3-9389-39e427f8b3a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:a6:7e', 'vm-uuid': 'a74dd695-4d4a-46e7-9897-4d3ffac83ba6'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:50 user nova-compute[75813]: INFO os_vif [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a6:7e,bridge_name='br-int',has_traffic_filtering=True,id=4b66b4a2-28a6-4dc3-9389-39e427f8b3a1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66b4a2-28')
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] No VIF found with MAC fa:16:3e:9a:a6:7e, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-eddd23eb-cfd0-4e2a-b535-bfba7657aa08 req-219a4465-9b6f-4308-acef-de130c411e10 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Updated VIF entry in instance network info cache for port 4b66b4a2-28a6-4dc3-9389-39e427f8b3a1. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG nova.network.neutron [req-eddd23eb-cfd0-4e2a-b535-bfba7657aa08 req-219a4465-9b6f-4308-acef-de130c411e10 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Updating instance_info_cache with network_info: [{"id": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "address": "fa:16:3e:9a:a6:7e", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66b4a2-28", "ovs_interfaceid": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:20:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-eddd23eb-cfd0-4e2a-b535-bfba7657aa08 req-219a4465-9b6f-4308-acef-de130c411e10 service nova] Releasing lock "refresh_cache-a74dd695-4d4a-46e7-9897-4d3ffac83ba6" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:20:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-0936dfce-4be1-4068-b15a-edda2a479ca6 req-64f0513d-4320-4f72-98be-e5a8b9f0bd85 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Received event network-vif-plugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0936dfce-4be1-4068-b15a-edda2a479ca6 req-64f0513d-4320-4f72-98be-e5a8b9f0bd85 service nova] Acquiring lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0936dfce-4be1-4068-b15a-edda2a479ca6 req-64f0513d-4320-4f72-98be-e5a8b9f0bd85 service nova] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0936dfce-4be1-4068-b15a-edda2a479ca6 req-64f0513d-4320-4f72-98be-e5a8b9f0bd85 service nova] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-0936dfce-4be1-4068-b15a-edda2a479ca6 req-64f0513d-4320-4f72-98be-e5a8b9f0bd85 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] No waiting events found dispatching network-vif-plugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:20:52 user nova-compute[75813]: WARNING nova.compute.manager [req-0936dfce-4be1-4068-b15a-edda2a479ca6 req-64f0513d-4320-4f72-98be-e5a8b9f0bd85 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Received unexpected event network-vif-plugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 for instance with vm_state building and task_state spawning.
Nov 15 13:20:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:20:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:20:53 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Instance spawned successfully.
Nov 15 13:20:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:20:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:20:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:20:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:20:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:20:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:20:53 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:20:54 user nova-compute[75813]: INFO nova.compute.manager [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 15 13:20:54 user nova-compute[75813]: DEBUG nova.compute.manager [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:20:54 user nova-compute[75813]: INFO nova.compute.manager [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Took 6.28 seconds to build instance.
Nov 15 13:20:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d74586f5-0aef-49f2-8e29-c097861dd249 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.372s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-92ff9d3e-40be-4bda-9883-492c9ae9f119 req-404e1934-755e-4128-80b2-75fbe2d4b956 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Received event network-vif-plugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:20:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-92ff9d3e-40be-4bda-9883-492c9ae9f119 req-404e1934-755e-4128-80b2-75fbe2d4b956 service nova] Acquiring lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:20:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-92ff9d3e-40be-4bda-9883-492c9ae9f119 req-404e1934-755e-4128-80b2-75fbe2d4b956 service nova] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:20:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-92ff9d3e-40be-4bda-9883-492c9ae9f119 req-404e1934-755e-4128-80b2-75fbe2d4b956 service nova] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:20:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-92ff9d3e-40be-4bda-9883-492c9ae9f119 req-404e1934-755e-4128-80b2-75fbe2d4b956 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] No waiting events found dispatching network-vif-plugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:20:54 user nova-compute[75813]: WARNING nova.compute.manager [req-92ff9d3e-40be-4bda-9883-492c9ae9f119 req-404e1934-755e-4128-80b2-75fbe2d4b956 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Received unexpected event network-vif-plugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 for instance with vm_state active and task_state None.
Nov 15 13:20:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:20:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:21:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:21:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:21:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:21:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:21:05 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:21:05 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:21:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:21:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:21:06 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:21:06 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updating instance_info_cache with network_info: [{"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:21:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:21:06 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:21:06 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:21:06 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:21:06 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:21:06 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:21:10 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:21:10 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:21:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:11 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:21:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:21:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:21:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:21:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:21:18 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:21:18 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:21:18 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8318MB free_disk=24.808990478515625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:21:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:21:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:21:19 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:21:19 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:21:19 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 51af821e-6a11-406e-95f6-0cd4501a6c33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:21:19 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:21:19 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance a74dd695-4d4a-46e7-9897-4d3ffac83ba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:21:19 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:21:19 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:21:19 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:21:19 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:21:19 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:21:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:21:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-90653b84-efd9-42c3-a3ff-7a89b8df8101 req-8cd32fe7-8fcc-4e07-8052-5d6c40dc094c service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-changed-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-90653b84-efd9-42c3-a3ff-7a89b8df8101 req-8cd32fe7-8fcc-4e07-8052-5d6c40dc094c service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Refreshing instance network info cache due to event network-changed-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-90653b84-efd9-42c3-a3ff-7a89b8df8101 req-8cd32fe7-8fcc-4e07-8052-5d6c40dc094c service nova] Acquiring lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-90653b84-efd9-42c3-a3ff-7a89b8df8101 req-8cd32fe7-8fcc-4e07-8052-5d6c40dc094c service nova] Acquired lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG nova.network.neutron [req-90653b84-efd9-42c3-a3ff-7a89b8df8101 req-8cd32fe7-8fcc-4e07-8052-5d6c40dc094c service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Refreshing network info cache for port 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG nova.network.neutron [req-90653b84-efd9-42c3-a3ff-7a89b8df8101 req-8cd32fe7-8fcc-4e07-8052-5d6c40dc094c service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updated VIF entry in instance network info cache for port 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG nova.network.neutron [req-90653b84-efd9-42c3-a3ff-7a89b8df8101 req-8cd32fe7-8fcc-4e07-8052-5d6c40dc094c service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updating instance_info_cache with network_info: [{"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-90653b84-efd9-42c3-a3ff-7a89b8df8101 req-8cd32fe7-8fcc-4e07-8052-5d6c40dc094c service nova] Releasing lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-294cefac-9f43-4e4a-a752-7179a20867f1 req-64210dc5-1015-4a88-ac3c-3fd45830abe3 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-changed-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-294cefac-9f43-4e4a-a752-7179a20867f1 req-64210dc5-1015-4a88-ac3c-3fd45830abe3 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Refreshing instance network info cache due to event network-changed-6b13cb80-a670-4df8-9d5a-56c84170e3c2. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-294cefac-9f43-4e4a-a752-7179a20867f1 req-64210dc5-1015-4a88-ac3c-3fd45830abe3 service nova] Acquiring lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-294cefac-9f43-4e4a-a752-7179a20867f1 req-64210dc5-1015-4a88-ac3c-3fd45830abe3 service nova] Acquired lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:21:58 user nova-compute[75813]: DEBUG nova.network.neutron [req-294cefac-9f43-4e4a-a752-7179a20867f1 req-64210dc5-1015-4a88-ac3c-3fd45830abe3 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Refreshing network info cache for port 6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.compute.manager [req-c9a9452c-2b9a-4bde-96b3-2e91a901f2b2 req-60bf396b-7ead-4fce-a305-75c3659a8c04 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-changed-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.compute.manager [req-c9a9452c-2b9a-4bde-96b3-2e91a901f2b2 req-60bf396b-7ead-4fce-a305-75c3659a8c04 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Refreshing instance network info cache due to event network-changed-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c9a9452c-2b9a-4bde-96b3-2e91a901f2b2 req-60bf396b-7ead-4fce-a305-75c3659a8c04 service nova] Acquiring lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c9a9452c-2b9a-4bde-96b3-2e91a901f2b2 req-60bf396b-7ead-4fce-a305-75c3659a8c04 service nova] Acquired lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.network.neutron [req-c9a9452c-2b9a-4bde-96b3-2e91a901f2b2 req-60bf396b-7ead-4fce-a305-75c3659a8c04 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Refreshing network info cache for port 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:21:59 user nova-compute[75813]: INFO nova.compute.manager [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Detaching volume a780249d-6aa8-4592-b686-045155c81093
Nov 15 13:21:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.network.neutron [req-294cefac-9f43-4e4a-a752-7179a20867f1 req-64210dc5-1015-4a88-ac3c-3fd45830abe3 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updated VIF entry in instance network info cache for port 6b13cb80-a670-4df8-9d5a-56c84170e3c2. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.network.neutron [req-294cefac-9f43-4e4a-a752-7179a20867f1 req-64210dc5-1015-4a88-ac3c-3fd45830abe3 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updating instance_info_cache with network_info: [{"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:21:59 user nova-compute[75813]: INFO nova.compute.manager [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Detaching volume fda1370c-2db9-4039-9578-4398cfd68b48
Nov 15 13:21:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-294cefac-9f43-4e4a-a752-7179a20867f1 req-64210dc5-1015-4a88-ac3c-3fd45830abe3 service nova] Releasing lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:21:59 user nova-compute[75813]: INFO nova.virt.block_device [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Attempting to driver detach volume a780249d-6aa8-4592-b686-045155c81093 from mountpoint /dev/vdb
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Attempting to detach device vdb from instance 51af821e-6a11-406e-95f6-0cd4501a6c33 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:21:59 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:21:59 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:21:59 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:21:59 user nova-compute[75813]:   <serial>a780249d-6aa8-4592-b686-045155c81093</serial>
Nov 15 13:21:59 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:21:59 user nova-compute[75813]: </disk>
Nov 15 13:21:59 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:21:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Successfully detached device vdb from instance 51af821e-6a11-406e-95f6-0cd4501a6c33 from the persistent domain config.
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51af821e-6a11-406e-95f6-0cd4501a6c33 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:21:59 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:21:59 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:21:59 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:21:59 user nova-compute[75813]:   <serial>a780249d-6aa8-4592-b686-045155c81093</serial>
Nov 15 13:21:59 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:21:59 user nova-compute[75813]: </disk>
Nov 15 13:21:59 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:21:59 user nova-compute[75813]: INFO nova.virt.block_device [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Attempting to driver detach volume fda1370c-2db9-4039-9578-4398cfd68b48 from mountpoint /dev/vdb
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Attempting to detach device vdb from instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:21:59 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:21:59 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:21:59 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:21:59 user nova-compute[75813]:   <serial>fda1370c-2db9-4039-9578-4398cfd68b48</serial>
Nov 15 13:21:59 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:21:59 user nova-compute[75813]: </disk>
Nov 15 13:21:59 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:21:59 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Successfully detached device vdb from instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 from the persistent domain config.
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:21:59 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:21:59 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:21:59 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:21:59 user nova-compute[75813]:   <serial>fda1370c-2db9-4039-9578-4398cfd68b48</serial>
Nov 15 13:21:59 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:21:59 user nova-compute[75813]: </disk>
Nov 15 13:21:59 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.network.neutron [req-c9a9452c-2b9a-4bde-96b3-2e91a901f2b2 req-60bf396b-7ead-4fce-a305-75c3659a8c04 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updated VIF entry in instance network info cache for port 9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG nova.network.neutron [req-c9a9452c-2b9a-4bde-96b3-2e91a901f2b2 req-60bf396b-7ead-4fce-a305-75c3659a8c04 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updating instance_info_cache with network_info: [{"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:21:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c9a9452c-2b9a-4bde-96b3-2e91a901f2b2 req-60bf396b-7ead-4fce-a305-75c3659a8c04 service nova] Releasing lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:22:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:22:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:22:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-55f01af0-870e-4331-a9bb-19ccf89da252 req-ec77da99-adc1-40cc-880e-85ad14a795db service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-changed-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-55f01af0-870e-4331-a9bb-19ccf89da252 req-ec77da99-adc1-40cc-880e-85ad14a795db service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Refreshing instance network info cache due to event network-changed-6b13cb80-a670-4df8-9d5a-56c84170e3c2. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:22:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-55f01af0-870e-4331-a9bb-19ccf89da252 req-ec77da99-adc1-40cc-880e-85ad14a795db service nova] Acquiring lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:22:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-55f01af0-870e-4331-a9bb-19ccf89da252 req-ec77da99-adc1-40cc-880e-85ad14a795db service nova] Acquired lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:22:01 user nova-compute[75813]: DEBUG nova.network.neutron [req-55f01af0-870e-4331-a9bb-19ccf89da252 req-ec77da99-adc1-40cc-880e-85ad14a795db service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Refreshing network info cache for port 6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:22:01 user nova-compute[75813]: DEBUG nova.network.neutron [req-55f01af0-870e-4331-a9bb-19ccf89da252 req-ec77da99-adc1-40cc-880e-85ad14a795db service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updated VIF entry in instance network info cache for port 6b13cb80-a670-4df8-9d5a-56c84170e3c2. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:22:01 user nova-compute[75813]: DEBUG nova.network.neutron [req-55f01af0-870e-4331-a9bb-19ccf89da252 req-ec77da99-adc1-40cc-880e-85ad14a795db service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updating instance_info_cache with network_info: [{"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:22:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-55f01af0-870e-4331-a9bb-19ccf89da252 req-ec77da99-adc1-40cc-880e-85ad14a795db service nova] Releasing lock "refresh_cache-51af821e-6a11-406e-95f6-0cd4501a6c33" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:22:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updating instance_info_cache with network_info: [{"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:22:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:22:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:22:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:22:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:22:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:22:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:12 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:22:12 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:22:13 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:22:13 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:22:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 51af821e-6a11-406e-95f6-0cd4501a6c33 is timed out.
Nov 15 13:22:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 is timed out.
Nov 15 13:22:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Successfully detached device vdb from instance 51af821e-6a11-406e-95f6-0cd4501a6c33 from the live domain config.
Nov 15 13:22:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Successfully detached device vdb from instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 from the live domain config.
Nov 15 13:22:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afNHiJCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:22:20 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaXduMvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:22:20 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17a16b2-26d6-443e-8de6-7df4cd86025a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:22:20 user nova-compute[75813]: No targets found.
Nov 15 13:22:20 user nova-compute[75813]: iSNS:
Nov 15 13:22:20 user nova-compute[75813]: No targets found.
Nov 15 13:22:20 user nova-compute[75813]: STATIC:
Nov 15 13:22:20 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48
Nov 15 13:22:20 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:22:20 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:22:20 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093
Nov 15 13:22:20 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:22:20 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:22:20 user nova-compute[75813]: FIRMWARE:
Nov 15 13:22:20 user nova-compute[75813]: No targets found.
Nov 15 13:22:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:22:20 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:22:20 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b139009-c68e-48e0-bd7d-bbf720018fd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e67e8bf-56a4-4c9c-ab1f-a04c897b7ad6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:22:20 user nova-compute[75813]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 (non-flash)
Nov 15 13:22:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 (non-flash)
Nov 15 13:22:20 user nova-compute[75813]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 (non-flash)
Nov 15 13:22:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550472680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093'): ({'sdc'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Removing single pathed devices sdc {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d019e16-084f-4f98-b73e-33afe064bd74]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[af33be46-e306-4c8e-9413-bef26ccccc56]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Flushing IO for device /dev/sdc {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[424f9ea4-b6b2-4c30-983e-fa51bc4234ee]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c9681a-fec9-44bc-9a0a-eaa088d275df]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:22:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:22:20 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8523MB free_disk=24.806304931640625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddb8cfd-d3aa-456a-a9fe-c3154b524715]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc81f27-9854-49eb-a13a-f6493ca6f992]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093, portal: 172.16.0.220,3260]
Nov 15 13:22:20 user nova-compute[75813]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093, portal: 172.16.0.220,3260] successful.
Nov 15 13:22:20 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a780249d-6aa8-4592-b686-045155c81093 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47e9001-f0ae-4c28-8f11-ce8073b7c16a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.679s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] <== disconnect_volume: return (681ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.680s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:22:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0dedd6-f01d-4d1c-bbbc-6cec70941a8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:22:21 user nova-compute[75813]: No targets found.
Nov 15 13:22:21 user nova-compute[75813]: iSNS:
Nov 15 13:22:21 user nova-compute[75813]: No targets found.
Nov 15 13:22:21 user nova-compute[75813]: STATIC:
Nov 15 13:22:21 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48
Nov 15 13:22:21 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:22:21 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:22:21 user nova-compute[75813]: FIRMWARE:
Nov 15 13:22:21 user nova-compute[75813]: No targets found.
Nov 15 13:22:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:22:21 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:22:21 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e4262f-aa1e-4caf-a8d3-01b09c967bcd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 51af821e-6a11-406e-95f6-0cd4501a6c33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance a74dd695-4d4a-46e7-9897-4d3ffac83ba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c8a0ed-d5ed-4c30-82cd-42f3ee7a6110]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 (non-flash)
Nov 15 13:22:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 (non-flash)
Nov 15 13:22:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5550473eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a054ca27-2806-43b5-823c-f8e910d6af6e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc303812-df21-44fa-b61c-8d352223f9e1]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c73fb5-05ee-4c06-995e-1b7129f852d5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead757c8-b91c-4c9a-b1b6-dc7554568308]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e9ad5d-0749-4a6a-b469-489e133d8e9c]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b05094-e593-4a60-b999-0ac916834aa1]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48, portal: 172.16.0.220,3260]
Nov 15 13:22:21 user nova-compute[75813]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48, portal: 172.16.0.220,3260] successful.
Nov 15 13:22:21 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda1370c-2db9-4039-9578-4398cfd68b48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[34763e51-8712-4008-94c9-aedc46df5529]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] <== disconnect_volume: return (976ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG nova.objects.instance [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'flavor' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:22:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2ddee2a4-896c-4370-a953-5bd5eb7b3c07 tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.332s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:22 user nova-compute[75813]: DEBUG nova.objects.instance [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'flavor' on Instance uuid 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:22:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-6a4bbea5-f57a-4def-a7dd-4b334b5f6394 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.817s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:22:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:22:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:22:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:22:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:22:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:38 user nova-compute[75813]: INFO nova.compute.manager [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Terminating instance
Nov 15 13:22:38 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-709971a2-1101-4b8f-b0b2-900d5ff5abe5 req-c6687462-a970-43dc-ad0d-b6eb375bb16a service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Received event network-vif-unplugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-709971a2-1101-4b8f-b0b2-900d5ff5abe5 req-c6687462-a970-43dc-ad0d-b6eb375bb16a service nova] Acquiring lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-709971a2-1101-4b8f-b0b2-900d5ff5abe5 req-c6687462-a970-43dc-ad0d-b6eb375bb16a service nova] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-709971a2-1101-4b8f-b0b2-900d5ff5abe5 req-c6687462-a970-43dc-ad0d-b6eb375bb16a service nova] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-709971a2-1101-4b8f-b0b2-900d5ff5abe5 req-c6687462-a970-43dc-ad0d-b6eb375bb16a service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] No waiting events found dispatching network-vif-unplugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-709971a2-1101-4b8f-b0b2-900d5ff5abe5 req-c6687462-a970-43dc-ad0d-b6eb375bb16a service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Received event network-vif-unplugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:22:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Instance destroyed successfully.
Nov 15 13:22:38 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lazy-loading 'resources' on Instance uuid a74dd695-4d4a-46e7-9897-4d3ffac83ba6 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-835925000',display_name='tempest-VolumesActionsTest-instance-835925000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-835925000',id=48,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7e0c39eb5ff4a26a35c7e07d0ed66f5',ramdisk_id='',reservation_id='r-2dkqvboi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1071662127',owner_user_name='tempest-VolumesActionsTest-1071662127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:20:54Z,user_data=None,user_id='172f130186f04b45a24337416d54780a',uuid=a74dd695-4d4a-46e7-9897-4d3ffac83ba6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "address": "fa:16:3e:9a:a6:7e", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66b4a2-28", "ovs_interfaceid": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converting VIF {"id": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "address": "fa:16:3e:9a:a6:7e", "network": {"id": "7ba2724a-33cf-4cf9-87db-a3138d56d8c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1194200686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7e0c39eb5ff4a26a35c7e07d0ed66f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b66b4a2-28", "ovs_interfaceid": "4b66b4a2-28a6-4dc3-9389-39e427f8b3a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a6:7e,bridge_name='br-int',has_traffic_filtering=True,id=4b66b4a2-28a6-4dc3-9389-39e427f8b3a1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66b4a2-28') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG os_vif [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a6:7e,bridge_name='br-int',has_traffic_filtering=True,id=4b66b4a2-28a6-4dc3-9389-39e427f8b3a1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66b4a2-28') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b66b4a2-28, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a4d762c-764f-4eb6-8650-be633590c5f9) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:38 user nova-compute[75813]: INFO os_vif [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a6:7e,bridge_name='br-int',has_traffic_filtering=True,id=4b66b4a2-28a6-4dc3-9389-39e427f8b3a1,network=Network(7ba2724a-33cf-4cf9-87db-a3138d56d8c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b66b4a2-28')
Nov 15 13:22:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Deleting instance files /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6_del
Nov 15 13:22:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Deletion of /opt/stack/data/nova/instances/a74dd695-4d4a-46e7-9897-4d3ffac83ba6_del complete
Nov 15 13:22:39 user nova-compute[75813]: INFO nova.compute.manager [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 13:22:39 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:22:39 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:22:39 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:22:39 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:39 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:22:39 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Took 0.49 seconds to deallocate network for instance.
Nov 15 13:22:39 user nova-compute[75813]: DEBUG nova.compute.manager [req-8c79a5f0-4267-4bc4-89cf-6715bbdc850e req-b91e7e6c-5c6d-41b7-96ad-6350357f942e service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Received event network-vif-deleted-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:39 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:22:39 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:22:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:39 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Deleted allocations for instance a74dd695-4d4a-46e7-9897-4d3ffac83ba6
Nov 15 13:22:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c73086b9-687a-41e0-b19d-cbefc153f6a2 tempest-VolumesActionsTest-1071662127 tempest-VolumesActionsTest-1071662127-project-member] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.585s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-50da5b98-73b3-49de-9756-7b54a2c7c443 req-e079faa3-50d6-4030-b7b1-7d0507327c77 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Received event network-vif-plugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50da5b98-73b3-49de-9756-7b54a2c7c443 req-e079faa3-50d6-4030-b7b1-7d0507327c77 service nova] Acquiring lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50da5b98-73b3-49de-9756-7b54a2c7c443 req-e079faa3-50d6-4030-b7b1-7d0507327c77 service nova] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-50da5b98-73b3-49de-9756-7b54a2c7c443 req-e079faa3-50d6-4030-b7b1-7d0507327c77 service nova] Lock "a74dd695-4d4a-46e7-9897-4d3ffac83ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-50da5b98-73b3-49de-9756-7b54a2c7c443 req-e079faa3-50d6-4030-b7b1-7d0507327c77 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] No waiting events found dispatching network-vif-plugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:22:40 user nova-compute[75813]: WARNING nova.compute.manager [req-50da5b98-73b3-49de-9756-7b54a2c7c443 req-e079faa3-50d6-4030-b7b1-7d0507327c77 service nova] [instance: a74dd695-4d4a-46e7-9897-4d3ffac83ba6] Received unexpected event network-vif-plugged-4b66b4a2-28a6-4dc3-9389-39e427f8b3a1 for instance with vm_state deleted and task_state None.
Nov 15 13:22:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:22:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:22:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:22:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:22:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:49 user nova-compute[75813]: INFO nova.compute.manager [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Terminating instance
Nov 15 13:22:49 user nova-compute[75813]: DEBUG nova.compute.manager [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:22:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:49 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-5944af61-d701-464e-906a-1818e4fb4254 req-e8f6bcf1-78ab-41a9-9370-9f19136af9a2 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5944af61-d701-464e-906a-1818e4fb4254 req-e8f6bcf1-78ab-41a9-9370-9f19136af9a2 service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5944af61-d701-464e-906a-1818e4fb4254 req-e8f6bcf1-78ab-41a9-9370-9f19136af9a2 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5944af61-d701-464e-906a-1818e4fb4254 req-e8f6bcf1-78ab-41a9-9370-9f19136af9a2 service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-5944af61-d701-464e-906a-1818e4fb4254 req-e8f6bcf1-78ab-41a9-9370-9f19136af9a2 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-5944af61-d701-464e-906a-1818e4fb4254 req-e8f6bcf1-78ab-41a9-9370-9f19136af9a2 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Instance destroyed successfully.
Nov 15 13:22:50 user nova-compute[75813]: DEBUG nova.objects.instance [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'resources' on Instance uuid 51af821e-6a11-406e-95f6-0cd4501a6c33 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-641669488',display_name='tempest-ServerRescueNegativeTestJSON-server-641669488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-641669488',id=44,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlylzbWO8l7Mulp5btslf0xF6sHF5XDSRD62oeDaTad9apG2CbMDrSjILb7W39BYYIjc+s0JZzh4+4huOUsOKMl8g6/VlGYg4vOb3fJ1SX1SfNIK0YKAeymlNj/oiAVpA==',key_name='tempest-keypair-2136231595',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:18:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-9l00sjy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:20:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=51af821e-6a11-406e-95f6-0cd4501a6c33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "address": "fa:16:3e:f0:91:72", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b13cb80-a6", "ovs_interfaceid": "6b13cb80-a670-4df8-9d5a-56c84170e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:91:72,bridge_name='br-int',has_traffic_filtering=True,id=6b13cb80-a670-4df8-9d5a-56c84170e3c2,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13cb80-a6') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG os_vif [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:91:72,bridge_name='br-int',has_traffic_filtering=True,id=6b13cb80-a670-4df8-9d5a-56c84170e3c2,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13cb80-a6') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b13cb80-a6, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b683f519-a6cc-4ac6-85ee-e582211be42a) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:50 user nova-compute[75813]: INFO os_vif [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:91:72,bridge_name='br-int',has_traffic_filtering=True,id=6b13cb80-a670-4df8-9d5a-56c84170e3c2,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b13cb80-a6')
Nov 15 13:22:50 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Deleting instance files /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33_del
Nov 15 13:22:50 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Deletion of /opt/stack/data/nova/instances/51af821e-6a11-406e-95f6-0cd4501a6c33_del complete
Nov 15 13:22:50 user nova-compute[75813]: INFO nova.compute.manager [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 13:22:50 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:22:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:51 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:22:51 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Took 1.19 seconds to deallocate network for instance.
Nov 15 13:22:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-acd3c495-ba85-4ca2-b490-acc1c8b32461 req-bce9caac-30ff-4c65-aafa-e9c157ec08c0 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-deleted-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:51 user nova-compute[75813]: INFO nova.compute.manager [req-acd3c495-ba85-4ca2-b490-acc1c8b32461 req-bce9caac-30ff-4c65-aafa-e9c157ec08c0 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Neutron deleted interface 6b13cb80-a670-4df8-9d5a-56c84170e3c2; detaching it from the instance and deleting it from the info cache
Nov 15 13:22:51 user nova-compute[75813]: DEBUG nova.network.neutron [req-acd3c495-ba85-4ca2-b490-acc1c8b32461 req-bce9caac-30ff-4c65-aafa-e9c157ec08c0 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:22:51 user nova-compute[75813]: DEBUG nova.compute.manager [req-acd3c495-ba85-4ca2-b490-acc1c8b32461 req-bce9caac-30ff-4c65-aafa-e9c157ec08c0 service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Detach interface failed, port_id=6b13cb80-a670-4df8-9d5a-56c84170e3c2, reason: Instance 51af821e-6a11-406e-95f6-0cd4501a6c33 could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 13:22:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:22:52 user nova-compute[75813]: WARNING nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state deleted and task_state None.
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:22:52 user nova-compute[75813]: WARNING nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state deleted and task_state None.
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:22:52 user nova-compute[75813]: WARNING nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state deleted and task_state None.
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:22:52 user nova-compute[75813]: WARNING nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-unplugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state deleted and task_state None.
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Acquiring lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] No waiting events found dispatching network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:22:52 user nova-compute[75813]: WARNING nova.compute.manager [req-3c589b81-6963-4043-9f1c-8cc6900dc620 req-1ebc5663-c661-478e-b921-93a4605bee3a service nova] [instance: 51af821e-6a11-406e-95f6-0cd4501a6c33] Received unexpected event network-vif-plugged-6b13cb80-a670-4df8-9d5a-56c84170e3c2 for instance with vm_state deleted and task_state None.
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:22:52 user nova-compute[75813]: INFO nova.compute.manager [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Terminating instance
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:52 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Deleted allocations for instance 51af821e-6a11-406e-95f6-0cd4501a6c33
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0da84184-4ede-4d0c-b6e9-031076bcb9ad tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "51af821e-6a11-406e-95f6-0cd4501a6c33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.542s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-faf643f5-ff1c-4dad-97b7-a45bb15b42d6 req-574c2006-b3bd-4fc2-94ff-eaf21c5a5522 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-vif-unplugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-faf643f5-ff1c-4dad-97b7-a45bb15b42d6 req-574c2006-b3bd-4fc2-94ff-eaf21c5a5522 service nova] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-faf643f5-ff1c-4dad-97b7-a45bb15b42d6 req-574c2006-b3bd-4fc2-94ff-eaf21c5a5522 service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-faf643f5-ff1c-4dad-97b7-a45bb15b42d6 req-574c2006-b3bd-4fc2-94ff-eaf21c5a5522 service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-faf643f5-ff1c-4dad-97b7-a45bb15b42d6 req-574c2006-b3bd-4fc2-94ff-eaf21c5a5522 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] No waiting events found dispatching network-vif-unplugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-faf643f5-ff1c-4dad-97b7-a45bb15b42d6 req-574c2006-b3bd-4fc2-94ff-eaf21c5a5522 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-vif-unplugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:22:52 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Instance destroyed successfully.
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.objects.instance [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lazy-loading 'resources' on Instance uuid 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1792958751',display_name='tempest-TestMinimumBasicScenario-server-1792958751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1792958751',id=46,image_ref='5e485f0e-e73e-4f22-a02b-8d0580e9fcf3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+f14XlWDfiA5B72cT6b2djcxfrLBwNCO3hL2Q6diNXpVtbS7f9Lj41alAQ+4fFsl7NFsmEbA1TzAjPBhB19S23wsp1TXIl/5KIINHMRi/kzz8GIkvlF4X+g+/Rymr7aA==',key_name='tempest-TestMinimumBasicScenario-833139215',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:18:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5875a3450c054f9490f65fa0a603e699',ramdisk_id='',reservation_id='r-wn8eu0s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5e485f0e-e73e-4f22-a02b-8d0580e9fcf3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-651110609',owner_user_name='tempest-TestMinimumBasicScenario-651110609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:20:14Z,user_data=None,user_id='ea5ceaf286514f268b169a27bbfd4006',uuid=0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converting VIF {"id": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "address": "fa:16:3e:8f:bc:d5", "network": {"id": "23f51aaa-2e33-4d12-8ad2-cddeb97f34f5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1625575364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5875a3450c054f9490f65fa0a603e699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dcab1cc-8c", "ovs_interfaceid": "9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dcab1cc-8c') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG os_vif [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dcab1cc-8c') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dcab1cc-8c, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18aaa058-c9d0-43bd-8292-9b5d59cf319e) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:22:52 user nova-compute[75813]: INFO os_vif [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f,network=Network(23f51aaa-2e33-4d12-8ad2-cddeb97f34f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dcab1cc-8c')
Nov 15 13:22:52 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Deleting instance files /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92_del
Nov 15 13:22:52 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Deletion of /opt/stack/data/nova/instances/0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92_del complete
Nov 15 13:22:52 user nova-compute[75813]: INFO nova.compute.manager [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 15 13:22:52 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:22:52 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:22:53 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:22:53 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Took 0.44 seconds to deallocate network for instance.
Nov 15 13:22:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:53 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:22:53 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:22:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:53 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Deleted allocations for instance 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92
Nov 15 13:22:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4ce96673-c157-420f-bf25-86f9f37c2132 tempest-TestMinimumBasicScenario-651110609 tempest-TestMinimumBasicScenario-651110609-project-member] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.600s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:53 user nova-compute[75813]: DEBUG nova.compute.manager [req-8e99b3dd-da15-4afc-a608-4797c831a42e req-8b417d6a-c0eb-46fc-8c7a-c3582dc42757 service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-vif-deleted-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-e5ab1a9f-b6c7-4446-9cf2-d8145b542e1a req-c1641a25-cd91-42a0-aaaf-d5985a1ea96f service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:22:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e5ab1a9f-b6c7-4446-9cf2-d8145b542e1a req-c1641a25-cd91-42a0-aaaf-d5985a1ea96f service nova] Acquiring lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:22:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e5ab1a9f-b6c7-4446-9cf2-d8145b542e1a req-c1641a25-cd91-42a0-aaaf-d5985a1ea96f service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:22:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e5ab1a9f-b6c7-4446-9cf2-d8145b542e1a req-c1641a25-cd91-42a0-aaaf-d5985a1ea96f service nova] Lock "0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:22:54 user nova-compute[75813]: DEBUG nova.compute.manager [req-e5ab1a9f-b6c7-4446-9cf2-d8145b542e1a req-c1641a25-cd91-42a0-aaaf-d5985a1ea96f service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] No waiting events found dispatching network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:22:54 user nova-compute[75813]: WARNING nova.compute.manager [req-e5ab1a9f-b6c7-4446-9cf2-d8145b542e1a req-c1641a25-cd91-42a0-aaaf-d5985a1ea96f service nova] [instance: 0411e0d0-a75a-4ea3-99a6-74f0e5a0ba92] Received unexpected event network-vif-plugged-9dcab1cc-8c5a-4dc3-adc7-ba85fab7035f for instance with vm_state deleted and task_state None.
Nov 15 13:22:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:23:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:23:08 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:23:08 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 13:23:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:23:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:23:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:23:08 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:23:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:23:13 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:23:14 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:23:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:23:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:23:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:23:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:23:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:23:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:23:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:23:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:23:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:23:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:23:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:23:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:23:20 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=24.889141082763672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:23:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:23:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:23:20 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:23:20 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:23:20 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:23:20 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:23:21 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:23:21 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:23:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:23:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:23:22 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:23:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:23:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Verify base images {{(pid=75813) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Image id 4d13142f-f571-4806-9713-890c0afeb458 yields fingerprint 9bc394db29c70cccb4e2c37ca320614ebac765a4 {{(pid=75813) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] image 4d13142f-f571-4806-9713-890c0afeb458 at (/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4): checking
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] image 4d13142f-f571-4806-9713-890c0afeb458 at (/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4): image is in use {{(pid=75813) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75813) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] eaff87f2-d74c-4e1b-b471-33bd1aeeed34 is a valid instance name {{(pid=75813) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] eaff87f2-d74c-4e1b-b471-33bd1aeeed34 has a disk file {{(pid=75813) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34 is backed by 9bc394db29c70cccb4e2c37ca320614ebac765a4 {{(pid=75813) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] ca55ee20-1155-4312-8508-a223654cd615 is a valid instance name {{(pid=75813) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] ca55ee20-1155-4312-8508-a223654cd615 has a disk file {{(pid=75813) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 is backed by 9bc394db29c70cccb4e2c37ca320614ebac765a4 {{(pid=75813) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 13:23:31 user nova-compute[75813]: WARNING nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8
Nov 15 13:23:31 user nova-compute[75813]: WARNING nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63
Nov 15 13:23:31 user nova-compute[75813]: WARNING nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704
Nov 15 13:23:31 user nova-compute[75813]: WARNING nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809
Nov 15 13:23:31 user nova-compute[75813]: WARNING nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Unknown base file: /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d
Nov 15 13:23:31 user nova-compute[75813]: WARNING nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae
Nov 15 13:23:31 user nova-compute[75813]: WARNING nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf
Nov 15 13:23:31 user nova-compute[75813]: WARNING nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Unknown base file: /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e
Nov 15 13:23:31 user nova-compute[75813]: WARNING nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Unknown base file: /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Active base files: /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Removable base files: /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8 /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63 /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704 /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809 /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b05e30a718dfc796109c38e4c57b6574275cd4b8
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5451d11a1c251653c821a6b327b5af3eb5579c63
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d13d8426b9ae3eb2defdd35e9089d6f64b798704
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a5140e4ce7ee409e96c5abccfb6a7ab03da93809
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aaedbf48f419030c097f9888d0889248c7e7f39d
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3d4655580f652f0f53323f34e45be3783eb5cdae
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cb39bedcbd04d4af399c93a866d711b2693b0cbf
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/45ac12f00469f059f9da69fdad2bbd6f97c6117e
Nov 15 13:23:31 user nova-compute[75813]: INFO nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aaaa33383a33d02153481d34b2df9ea69e6401d7
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Verification complete {{(pid=75813) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Verify swap images {{(pid=75813) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 13:23:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.imagecache [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Verify ephemeral images {{(pid=75813) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 13:23:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:23:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:23:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:42 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:23:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:23:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:23:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:23:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:23:46 user nova-compute[75813]: INFO nova.compute.manager [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Terminating instance
Nov 15 13:23:46 user nova-compute[75813]: DEBUG nova.compute.manager [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-a3a88264-d7d1-49f4-bd00-0e15e7bb223d req-fc54064d-98fa-4907-a2da-4009827f0889 service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received event network-vif-unplugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a3a88264-d7d1-49f4-bd00-0e15e7bb223d req-fc54064d-98fa-4907-a2da-4009827f0889 service nova] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a3a88264-d7d1-49f4-bd00-0e15e7bb223d req-fc54064d-98fa-4907-a2da-4009827f0889 service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a3a88264-d7d1-49f4-bd00-0e15e7bb223d req-fc54064d-98fa-4907-a2da-4009827f0889 service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-a3a88264-d7d1-49f4-bd00-0e15e7bb223d req-fc54064d-98fa-4907-a2da-4009827f0889 service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] No waiting events found dispatching network-vif-unplugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG nova.compute.manager [req-a3a88264-d7d1-49f4-bd00-0e15e7bb223d req-fc54064d-98fa-4907-a2da-4009827f0889 service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received event network-vif-unplugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Instance destroyed successfully.
Nov 15 13:23:47 user nova-compute[75813]: DEBUG nova.objects.instance [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'resources' on Instance uuid eaff87f2-d74c-4e1b-b471-33bd1aeeed34 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556918182',display_name='tempest-ServerRescueNegativeTestJSON-server-1556918182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556918182',id=35,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:09:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-jo61jy29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:09:40Z,user_data=None,user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=eaff87f2-d74c-4e1b-b471-33bd1aeeed34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "address": "fa:16:3e:72:7b:99", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f83e206-bb", "ovs_interfaceid": "7f83e206-bb7e-4d53-a7fa-00c36bf649de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=7f83e206-bb7e-4d53-a7fa-00c36bf649de,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f83e206-bb') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG os_vif [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=7f83e206-bb7e-4d53-a7fa-00c36bf649de,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f83e206-bb') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f83e206-bb, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ac9a577-cc22-49f1-8784-52b7786e9650) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:23:47 user nova-compute[75813]: INFO os_vif [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=7f83e206-bb7e-4d53-a7fa-00c36bf649de,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f83e206-bb')
Nov 15 13:23:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Deleting instance files /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34_del
Nov 15 13:23:47 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Deletion of /opt/stack/data/nova/instances/eaff87f2-d74c-4e1b-b471-33bd1aeeed34_del complete
Nov 15 13:23:47 user nova-compute[75813]: INFO nova.compute.manager [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 15 13:23:47 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:23:47 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:23:48 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:23:48 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Took 0.53 seconds to deallocate network for instance.
Nov 15 13:23:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:23:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:23:48 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:23:48 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:23:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:23:48 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Deleted allocations for instance eaff87f2-d74c-4e1b-b471-33bd1aeeed34
Nov 15 13:23:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b3abb4d4-1aa2-4e4f-ba90-05531351bf4d tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.955s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:23:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-23e85563-4e91-47d6-9b16-e6113bfa3622 req-56e555e9-2df3-43bd-9f0e-4b3fe5096e73 service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:23:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-23e85563-4e91-47d6-9b16-e6113bfa3622 req-56e555e9-2df3-43bd-9f0e-4b3fe5096e73 service nova] Acquiring lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:23:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-23e85563-4e91-47d6-9b16-e6113bfa3622 req-56e555e9-2df3-43bd-9f0e-4b3fe5096e73 service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:23:49 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-23e85563-4e91-47d6-9b16-e6113bfa3622 req-56e555e9-2df3-43bd-9f0e-4b3fe5096e73 service nova] Lock "eaff87f2-d74c-4e1b-b471-33bd1aeeed34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:23:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-23e85563-4e91-47d6-9b16-e6113bfa3622 req-56e555e9-2df3-43bd-9f0e-4b3fe5096e73 service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] No waiting events found dispatching network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:23:49 user nova-compute[75813]: WARNING nova.compute.manager [req-23e85563-4e91-47d6-9b16-e6113bfa3622 req-56e555e9-2df3-43bd-9f0e-4b3fe5096e73 service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received unexpected event network-vif-plugged-7f83e206-bb7e-4d53-a7fa-00c36bf649de for instance with vm_state deleted and task_state None.
Nov 15 13:23:49 user nova-compute[75813]: DEBUG nova.compute.manager [req-23e85563-4e91-47d6-9b16-e6113bfa3622 req-56e555e9-2df3-43bd-9f0e-4b3fe5096e73 service nova] [instance: eaff87f2-d74c-4e1b-b471-33bd1aeeed34] Received event network-vif-deleted-7f83e206-bb7e-4d53-a7fa-00c36bf649de {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:23:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:52 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:23:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:24:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:04 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:04 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75813) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 13:24:05 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:06 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:06 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:24:06 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:24:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:24:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:24:06 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca55ee20-1155-4312-8508-a223654cd615] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:24:06 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:24:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updating instance_info_cache with network_info: [{"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:24:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-ca55ee20-1155-4312-8508-a223654cd615" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:24:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:24:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 13:24:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] There are 0 instances to clean {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 13:24:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:08 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:24:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:14 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:14 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:24:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:15 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:24:15 user nova-compute[75813]: INFO nova.compute.claims [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Claim successful on node user
Nov 15 13:24:16 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:24:16 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:24:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG nova.policy [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbdb7b2991154ce3a6d20c20d008cdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7634e1eefe424298288ff6eccc5710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:24:16 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Creating image(s)
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "/opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "/opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.167s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk 1073741824" returned: 0 in 0.094s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:24:16 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Successfully created port: 211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.191s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Cannot resize image /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Ensure instance console log exists: /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Successfully updated port: 211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquired lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-b2874dbf-0378-4e21-8738-5bc72b4bc36e req-0b35ed33-de2f-4d6c-b445-d819f02b9fe0 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Received event network-changed-211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-b2874dbf-0378-4e21-8738-5bc72b4bc36e req-0b35ed33-de2f-4d6c-b445-d819f02b9fe0 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Refreshing instance network info cache due to event network-changed-211bb75c-45f6-450d-916b-3de2dfb4d71a. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b2874dbf-0378-4e21-8738-5bc72b4bc36e req-0b35ed33-de2f-4d6c-b445-d819f02b9fe0 service nova] Acquiring lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.network.neutron [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Updating instance_info_cache with network_info: [{"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Releasing lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Instance network_info: |[{"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b2874dbf-0378-4e21-8738-5bc72b4bc36e req-0b35ed33-de2f-4d6c-b445-d819f02b9fe0 service nova] Acquired lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.network.neutron [req-b2874dbf-0378-4e21-8738-5bc72b4bc36e req-0b35ed33-de2f-4d6c-b445-d819f02b9fe0 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Refreshing network info cache for port 211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Start _get_guest_xml network_info=[{"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:24:17 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:24:17 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-288804365',display_name='tempest-VolumesSnapshotTestJSON-instance-288804365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-288804365',id=49,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWY68MhSexov1C68J00eIWusBCfcGZllncpuGQUYCCYU9SNNptsw1l9i92aGAieWc9F1oWRAHWpdRFxe7aFAlD+D25VRJrQt3wfDTCm9nd2jtUUbPhdMc7m7JFeZclUIg==',key_name='tempest-keypair-539809595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e7634e1eefe424298288ff6eccc5710',ramdisk_id='',reservation_id='r-588jvgvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1381735690',owner_user_name='tempest-VolumesSnapshotTestJSON-1381735690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdb7b2991154ce3a6d20c20d008cdba',uuid=cd9f4868-0d91-4757-bb5e-520ba33bca94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converting VIF {"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:33:40,bridge_name='br-int',has_traffic_filtering=True,id=211bb75c-45f6-450d-916b-3de2dfb4d71a,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211bb75c-45') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lazy-loading 'pci_devices' on Instance uuid cd9f4868-0d91-4757-bb5e-520ba33bca94 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:24:17 user nova-compute[75813]:   <uuid>cd9f4868-0d91-4757-bb5e-520ba33bca94</uuid>
Nov 15 13:24:17 user nova-compute[75813]:   <name>instance-00000031</name>
Nov 15 13:24:17 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:24:17 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:24:17 user nova-compute[75813]:   <metadata>
Nov 15 13:24:17 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:24:17 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:24:17 user nova-compute[75813]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-288804365</nova:name>
Nov 15 13:24:17 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:24:17</nova:creationTime>
Nov 15 13:24:17 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:24:17 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:24:17 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:24:17 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:24:17 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:24:17 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:24:17 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:24:17 user nova-compute[75813]:       <nova:owner>
Nov 15 13:24:17 user nova-compute[75813]:         <nova:user uuid="cbdb7b2991154ce3a6d20c20d008cdba">tempest-VolumesSnapshotTestJSON-1381735690-project-member</nova:user>
Nov 15 13:24:17 user nova-compute[75813]:         <nova:project uuid="6e7634e1eefe424298288ff6eccc5710">tempest-VolumesSnapshotTestJSON-1381735690</nova:project>
Nov 15 13:24:17 user nova-compute[75813]:       </nova:owner>
Nov 15 13:24:17 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:24:17 user nova-compute[75813]:       <nova:ports>
Nov 15 13:24:17 user nova-compute[75813]:         <nova:port uuid="211bb75c-45f6-450d-916b-3de2dfb4d71a">
Nov 15 13:24:17 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 13:24:17 user nova-compute[75813]:         </nova:port>
Nov 15 13:24:17 user nova-compute[75813]:       </nova:ports>
Nov 15 13:24:17 user nova-compute[75813]:     </nova:instance>
Nov 15 13:24:17 user nova-compute[75813]:   </metadata>
Nov 15 13:24:17 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:24:17 user nova-compute[75813]:     <system>
Nov 15 13:24:17 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:24:17 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:24:17 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:24:17 user nova-compute[75813]:       <entry name="serial">cd9f4868-0d91-4757-bb5e-520ba33bca94</entry>
Nov 15 13:24:17 user nova-compute[75813]:       <entry name="uuid">cd9f4868-0d91-4757-bb5e-520ba33bca94</entry>
Nov 15 13:24:17 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:24:17 user nova-compute[75813]:     </system>
Nov 15 13:24:17 user nova-compute[75813]:   </sysinfo>
Nov 15 13:24:17 user nova-compute[75813]:   <os>
Nov 15 13:24:17 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:24:17 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:24:17 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:24:17 user nova-compute[75813]:   </os>
Nov 15 13:24:17 user nova-compute[75813]:   <features>
Nov 15 13:24:17 user nova-compute[75813]:     <acpi/>
Nov 15 13:24:17 user nova-compute[75813]:     <apic/>
Nov 15 13:24:17 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:24:17 user nova-compute[75813]:   </features>
Nov 15 13:24:17 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:24:17 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:24:17 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:24:17 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:24:17 user nova-compute[75813]:   </clock>
Nov 15 13:24:17 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:24:17 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:24:17 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:24:17 user nova-compute[75813]:   </cpu>
Nov 15 13:24:17 user nova-compute[75813]:   <devices>
Nov 15 13:24:17 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:24:17 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:24:17 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk"/>
Nov 15 13:24:17 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:24:17 user nova-compute[75813]:     </disk>
Nov 15 13:24:17 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:24:17 user nova-compute[75813]:       <mac address="fa:16:3e:36:33:40"/>
Nov 15 13:24:17 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:24:17 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:24:17 user nova-compute[75813]:       <target dev="tap211bb75c-45"/>
Nov 15 13:24:17 user nova-compute[75813]:     </interface>
Nov 15 13:24:17 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:24:17 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/console.log" append="off"/>
Nov 15 13:24:17 user nova-compute[75813]:     </serial>
Nov 15 13:24:17 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:24:17 user nova-compute[75813]:     <video>
Nov 15 13:24:17 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:24:17 user nova-compute[75813]:     </video>
Nov 15 13:24:17 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:24:17 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:24:17 user nova-compute[75813]:     </rng>
Nov 15 13:24:17 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:24:17 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:24:17 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:24:17 user nova-compute[75813]:     </memballoon>
Nov 15 13:24:17 user nova-compute[75813]:   </devices>
Nov 15 13:24:17 user nova-compute[75813]: </domain>
Nov 15 13:24:17 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-288804365',display_name='tempest-VolumesSnapshotTestJSON-instance-288804365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-288804365',id=49,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWY68MhSexov1C68J00eIWusBCfcGZllncpuGQUYCCYU9SNNptsw1l9i92aGAieWc9F1oWRAHWpdRFxe7aFAlD+D25VRJrQt3wfDTCm9nd2jtUUbPhdMc7m7JFeZclUIg==',key_name='tempest-keypair-539809595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e7634e1eefe424298288ff6eccc5710',ramdisk_id='',reservation_id='r-588jvgvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1381735690',owner_user_name='tempest-VolumesSnapshotTestJSON-1381735690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdb7b2991154ce3a6d20c20d008cdba',uuid=cd9f4868-0d91-4757-bb5e-520ba33bca94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converting VIF {"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:33:40,bridge_name='br-int',has_traffic_filtering=True,id=211bb75c-45f6-450d-916b-3de2dfb4d71a,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211bb75c-45') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG os_vif [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:33:40,bridge_name='br-int',has_traffic_filtering=True,id=211bb75c-45f6-450d-916b-3de2dfb4d71a,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211bb75c-45') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e73ea06-51ac-5f12-9fee-c420512babc5', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap211bb75c-45, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap211bb75c-45, col_values=(('qos', UUID('2d949a24-3853-4f34-a530-39de582aca40')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap211bb75c-45, col_values=(('external_ids', {'iface-id': '211bb75c-45f6-450d-916b-3de2dfb4d71a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:33:40', 'vm-uuid': 'cd9f4868-0d91-4757-bb5e-520ba33bca94'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:24:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:17 user nova-compute[75813]: INFO os_vif [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:33:40,bridge_name='br-int',has_traffic_filtering=True,id=211bb75c-45f6-450d-916b-3de2dfb4d71a,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211bb75c-45')
Nov 15 13:24:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:24:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] No VIF found with MAC fa:16:3e:36:33:40, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:24:18 user nova-compute[75813]: DEBUG nova.network.neutron [req-b2874dbf-0378-4e21-8738-5bc72b4bc36e req-0b35ed33-de2f-4d6c-b445-d819f02b9fe0 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Updated VIF entry in instance network info cache for port 211bb75c-45f6-450d-916b-3de2dfb4d71a. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:24:18 user nova-compute[75813]: DEBUG nova.network.neutron [req-b2874dbf-0378-4e21-8738-5bc72b4bc36e req-0b35ed33-de2f-4d6c-b445-d819f02b9fe0 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Updating instance_info_cache with network_info: [{"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:24:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b2874dbf-0378-4e21-8738-5bc72b4bc36e req-0b35ed33-de2f-4d6c-b445-d819f02b9fe0 service nova] Releasing lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-d8b7ddaf-1f43-4dae-8b75-cb4dec8ace39 req-19c2a513-399f-4a6f-ac4b-6e73b971c0cc service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Received event network-vif-plugged-211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d8b7ddaf-1f43-4dae-8b75-cb4dec8ace39 req-19c2a513-399f-4a6f-ac4b-6e73b971c0cc service nova] Acquiring lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d8b7ddaf-1f43-4dae-8b75-cb4dec8ace39 req-19c2a513-399f-4a6f-ac4b-6e73b971c0cc service nova] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d8b7ddaf-1f43-4dae-8b75-cb4dec8ace39 req-19c2a513-399f-4a6f-ac4b-6e73b971c0cc service nova] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG nova.compute.manager [req-d8b7ddaf-1f43-4dae-8b75-cb4dec8ace39 req-19c2a513-399f-4a6f-ac4b-6e73b971c0cc service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] No waiting events found dispatching network-vif-plugged-211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:24:19 user nova-compute[75813]: WARNING nova.compute.manager [req-d8b7ddaf-1f43-4dae-8b75-cb4dec8ace39 req-19c2a513-399f-4a6f-ac4b-6e73b971c0cc service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Received unexpected event network-vif-plugged-211bb75c-45f6-450d-916b-3de2dfb4d71a for instance with vm_state building and task_state spawning.
Nov 15 13:24:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:24:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:24:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:24:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:24:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:24:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:24:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:24:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:24:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:24:20 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8930MB free_disk=24.954071044921875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:24:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance ca55ee20-1155-4312-8508-a223654cd615 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance cd9f4868-0d91-4757-bb5e-520ba33bca94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing inventories for resource provider 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating ProviderTree inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing aggregate associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, aggregates: None {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing trait associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, traits: HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-a2101f7b-98fb-4f6b-9329-e86da6499140 req-66428ee7-67b3-4d5a-8f66-8536836cb7f2 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Received event network-vif-plugged-211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a2101f7b-98fb-4f6b-9329-e86da6499140 req-66428ee7-67b3-4d5a-8f66-8536836cb7f2 service nova] Acquiring lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a2101f7b-98fb-4f6b-9329-e86da6499140 req-66428ee7-67b3-4d5a-8f66-8536836cb7f2 service nova] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a2101f7b-98fb-4f6b-9329-e86da6499140 req-66428ee7-67b3-4d5a-8f66-8536836cb7f2 service nova] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.compute.manager [req-a2101f7b-98fb-4f6b-9329-e86da6499140 req-66428ee7-67b3-4d5a-8f66-8536836cb7f2 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] No waiting events found dispatching network-vif-plugged-211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:24:21 user nova-compute[75813]: WARNING nova.compute.manager [req-a2101f7b-98fb-4f6b-9329-e86da6499140 req-66428ee7-67b3-4d5a-8f66-8536836cb7f2 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Received unexpected event network-vif-plugged-211bb75c-45f6-450d-916b-3de2dfb4d71a for instance with vm_state building and task_state spawning.
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:24:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Instance spawned successfully.
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:24:21 user nova-compute[75813]: INFO nova.compute.manager [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 15 13:24:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:24:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:21 user nova-compute[75813]: INFO nova.compute.manager [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Took 5.90 seconds to build instance.
Nov 15 13:24:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c58c4715-43d8-4332-aa49-b4313a62a586 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.984s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:27 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:32 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:24:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "ca55ee20-1155-4312-8508-a223654cd615" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:37 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:37 user nova-compute[75813]: INFO nova.compute.manager [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Terminating instance
Nov 15 13:24:37 user nova-compute[75813]: DEBUG nova.compute.manager [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:24:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:37 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-e81acd3d-e51b-4ce7-8f1d-78187889b739 req-355b2aaf-27b7-4c6a-af97-5819dbcfe9a8 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-unplugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e81acd3d-e51b-4ce7-8f1d-78187889b739 req-355b2aaf-27b7-4c6a-af97-5819dbcfe9a8 service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e81acd3d-e51b-4ce7-8f1d-78187889b739 req-355b2aaf-27b7-4c6a-af97-5819dbcfe9a8 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-e81acd3d-e51b-4ce7-8f1d-78187889b739 req-355b2aaf-27b7-4c6a-af97-5819dbcfe9a8 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-e81acd3d-e51b-4ce7-8f1d-78187889b739 req-355b2aaf-27b7-4c6a-af97-5819dbcfe9a8 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-unplugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG nova.compute.manager [req-e81acd3d-e51b-4ce7-8f1d-78187889b739 req-355b2aaf-27b7-4c6a-af97-5819dbcfe9a8 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-unplugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:24:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: ca55ee20-1155-4312-8508-a223654cd615] Instance destroyed successfully.
Nov 15 13:24:38 user nova-compute[75813]: DEBUG nova.objects.instance [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lazy-loading 'resources' on Instance uuid ca55ee20-1155-4312-8508-a223654cd615 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-988378064',display_name='tempest-ServerRescueNegativeTestJSON-server-988378064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-988378064',id=33,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:12:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71da470a3bdb4093bc2b5db0b66fa08e',ramdisk_id='',reservation_id='r-81rws25z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475327670',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475327670-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:14:25Z,user_data=None,user_id='754cbdd42e894349bdacf3a0c7ba06cc',uuid=ca55ee20-1155-4312-8508-a223654cd615,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converting VIF {"id": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "address": "fa:16:3e:1b:2f:d1", "network": {"id": "9a5a3997-3c8c-4163-bbc9-35da3d93e87b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1923688257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71da470a3bdb4093bc2b5db0b66fa08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9960cf-b2", "ovs_interfaceid": "ab9960cf-b2b9-45d5-aedd-a314edf7cbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:2f:d1,bridge_name='br-int',has_traffic_filtering=True,id=ab9960cf-b2b9-45d5-aedd-a314edf7cbe4,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9960cf-b2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG os_vif [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:2f:d1,bridge_name='br-int',has_traffic_filtering=True,id=ab9960cf-b2b9-45d5-aedd-a314edf7cbe4,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9960cf-b2') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab9960cf-b2, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41d1e720-ee6c-45a3-99e3-5217eece5ea8) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:38 user nova-compute[75813]: INFO os_vif [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:2f:d1,bridge_name='br-int',has_traffic_filtering=True,id=ab9960cf-b2b9-45d5-aedd-a314edf7cbe4,network=Network(9a5a3997-3c8c-4163-bbc9-35da3d93e87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9960cf-b2')
Nov 15 13:24:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Deleting instance files /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615_del
Nov 15 13:24:38 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Deletion of /opt/stack/data/nova/instances/ca55ee20-1155-4312-8508-a223654cd615_del complete
Nov 15 13:24:38 user nova-compute[75813]: INFO nova.compute.manager [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] [instance: ca55ee20-1155-4312-8508-a223654cd615] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 13:24:38 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: ca55ee20-1155-4312-8508-a223654cd615] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:24:38 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: ca55ee20-1155-4312-8508-a223654cd615] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:24:39 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: ca55ee20-1155-4312-8508-a223654cd615] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:24:39 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: ca55ee20-1155-4312-8508-a223654cd615] Took 0.46 seconds to deallocate network for instance.
Nov 15 13:24:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:39 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:24:39 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:24:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:39 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Deleted allocations for instance ca55ee20-1155-4312-8508-a223654cd615
Nov 15 13:24:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-a8e9e955-96dd-404e-8fc9-7d426ea9aebd tempest-ServerRescueNegativeTestJSON-1475327670 tempest-ServerRescueNegativeTestJSON-1475327670-project-member] Lock "ca55ee20-1155-4312-8508-a223654cd615" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.615s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-5c4b6bd7-e922-490c-95bb-1683f5eb561f req-d75f1a4d-bfb6-4986-a5a3-c1e7bc96cd16 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:24:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c4b6bd7-e922-490c-95bb-1683f5eb561f req-d75f1a4d-bfb6-4986-a5a3-c1e7bc96cd16 service nova] Acquiring lock "ca55ee20-1155-4312-8508-a223654cd615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c4b6bd7-e922-490c-95bb-1683f5eb561f req-d75f1a4d-bfb6-4986-a5a3-c1e7bc96cd16 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:40 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5c4b6bd7-e922-490c-95bb-1683f5eb561f req-d75f1a4d-bfb6-4986-a5a3-c1e7bc96cd16 service nova] Lock "ca55ee20-1155-4312-8508-a223654cd615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-5c4b6bd7-e922-490c-95bb-1683f5eb561f req-d75f1a4d-bfb6-4986-a5a3-c1e7bc96cd16 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] No waiting events found dispatching network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:24:40 user nova-compute[75813]: WARNING nova.compute.manager [req-5c4b6bd7-e922-490c-95bb-1683f5eb561f req-d75f1a4d-bfb6-4986-a5a3-c1e7bc96cd16 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received unexpected event network-vif-plugged-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 for instance with vm_state deleted and task_state None.
Nov 15 13:24:40 user nova-compute[75813]: DEBUG nova.compute.manager [req-5c4b6bd7-e922-490c-95bb-1683f5eb561f req-d75f1a4d-bfb6-4986-a5a3-c1e7bc96cd16 service nova] [instance: ca55ee20-1155-4312-8508-a223654cd615] Received event network-vif-deleted-ab9960cf-b2b9-45d5-aedd-a314edf7cbe4 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:24:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:51 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:24:51 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Triggering sync for uuid cd9f4868-0d91-4757-bb5e-520ba33bca94 {{(pid=75813) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 13:24:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:24:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:24:51 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:24:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:24:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:25:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:25:06 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:25:07 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:25:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:25:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:25:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:25:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:25:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:25:07 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid cd9f4868-0d91-4757-bb5e-520ba33bca94 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:25:07 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Updating instance_info_cache with network_info: [{"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:25:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:25:07 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:25:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:25:09 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:25:10 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:25:10 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:25:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:25:16 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:25:16 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:25:17 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:25:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:25:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:25:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:25:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:25:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:25:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:25:20 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:25:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:25:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:25:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:25:20 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:25:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:25:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:25:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:25:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:25:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:25:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:25:20 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=24.945377349853516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:25:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:25:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:25:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance cd9f4868-0d91-4757-bb5e-520ba33bca94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:25:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:25:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:25:21 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:25:21 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:25:21 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:25:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:25:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:25:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:25:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:25:29 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:25:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:25:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:25:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:25:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:25:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:25:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:25:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:25:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:25:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:25:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:25:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:25:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:25:59 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:06 user nova-compute[75813]: DEBUG nova.compute.manager [req-0eaff2e3-c1ea-46b1-8adb-46c6d3974e4c req-dc0daf54-7406-466c-a599-7bae15d1cca9 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Received event network-changed-211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:26:06 user nova-compute[75813]: DEBUG nova.compute.manager [req-0eaff2e3-c1ea-46b1-8adb-46c6d3974e4c req-dc0daf54-7406-466c-a599-7bae15d1cca9 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Refreshing instance network info cache due to event network-changed-211bb75c-45f6-450d-916b-3de2dfb4d71a. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:26:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0eaff2e3-c1ea-46b1-8adb-46c6d3974e4c req-dc0daf54-7406-466c-a599-7bae15d1cca9 service nova] Acquiring lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:26:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0eaff2e3-c1ea-46b1-8adb-46c6d3974e4c req-dc0daf54-7406-466c-a599-7bae15d1cca9 service nova] Acquired lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:26:06 user nova-compute[75813]: DEBUG nova.network.neutron [req-0eaff2e3-c1ea-46b1-8adb-46c6d3974e4c req-dc0daf54-7406-466c-a599-7bae15d1cca9 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Refreshing network info cache for port 211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG nova.network.neutron [req-0eaff2e3-c1ea-46b1-8adb-46c6d3974e4c req-dc0daf54-7406-466c-a599-7bae15d1cca9 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Updated VIF entry in instance network info cache for port 211bb75c-45f6-450d-916b-3de2dfb4d71a. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG nova.network.neutron [req-0eaff2e3-c1ea-46b1-8adb-46c6d3974e4c req-dc0daf54-7406-466c-a599-7bae15d1cca9 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Updating instance_info_cache with network_info: [{"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lazy-loading 'flavor' on Instance uuid cd9f4868-0d91-4757-bb5e-520ba33bca94 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0eaff2e3-c1ea-46b1-8adb-46c6d3974e4c req-dc0daf54-7406-466c-a599-7bae15d1cca9 service nova] Releasing lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:26:07 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Ignoring supplied device name: /dev/vdb
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:07 user nova-compute[75813]: INFO nova.compute.manager [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Attaching volume 49c0fad0-a2ae-407e-b462-5b635108c9ab to /dev/vdb
Nov 15 13:26:07 user nova-compute[75813]: DEBUG os_brick.utils [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e97ec6-782f-49e6-a2ab-1642e51710c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[71514838-db47-442b-bee5-88945b685e96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579e43c-822d-463f-9c6e-aa47764c1598]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[347f451b-811f-4fc8-af37-58e9aefe5a88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:26:07 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:26:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a6f75e-b8ff-43d1-95c1-985b241a321d]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG os_brick.utils [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:26:07 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Updating existing volume attachment record: b5f2315b-4bc2-4132-9766-c587d8f5d262 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:26:08 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:26:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:09 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:26:09 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:26:09 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:26:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:26:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:26:09 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:26:09 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid cd9f4868-0d91-4757-bb5e-520ba33bca94 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:26:09 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Updating instance_info_cache with network_info: [{"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:26:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-cd9f4868-0d91-4757-bb5e-520ba33bca94" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:26:09 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:26:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:10 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:26:11 user nova-compute[75813]: INFO nova.compute.claims [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Claim successful on node user
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:26:11 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:26:11 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG nova.policy [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10553688115447f896d71704b1c96058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52541ee36f04906b3bb28413efbd8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:26:11 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Creating image(s)
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "/opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "/opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "/opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk 1073741824" returned: 0 in 0.084s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Cannot resize image /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Ensure instance console log exists: /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Successfully created port: 689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioyOrnEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:26:12 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:26:12 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:26:12 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e143e8-977f-4c19-9763-eb7353b453a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:26:12 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba09ed3b-666b-4fd1-a49d-588695a6468b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab] added
Nov 15 13:26:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea9576c-a274-422d-bbe2-73fda26dd8bc]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05b9b5c-81ef-41d5-be27-04da58d12ae2]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ioyOrnEI {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ioyOrnEI" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[765179a2-2ba3-4e66-8ec7-6112b1c286ff]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ioyOrnEI'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc439d9-924a-4c26-bc46-39c44413634d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[be19792d-f40a-4b3f-9f56-13b1fa6ea5b6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:26:12 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:26:12 user nova-compute[75813]:  {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:26:12 user nova-compute[75813]: WARNING os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 13:26:12 user nova-compute[75813]: 
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb0972-8703-4748-ac0c-c1e4768fc466]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab, portal: 172.16.0.220,3260]
Nov 15 13:26:12 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab, portal: 172.16.0.220,3260] successful.
Nov 15 13:26:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8315706-4451-4a8f-b95b-2c843d5672de]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3331f2-e508-4650-993f-ba315f013b3d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab (non-flash)
Nov 15 13:26:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab (non-flash)
Nov 15 13:26:12 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e4880c-fb2f-4860-b83f-787951d7d689]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioyOrnEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:26:12 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Successfully updated port: 689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquired lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-8d37441c-edfe-4dc6-90f3-7ac9fc637a05 req-d5df9e85-5c6d-481e-8a30-bbfd0a95c713 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Received event network-changed-689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-8d37441c-edfe-4dc6-90f3-7ac9fc637a05 req-d5df9e85-5c6d-481e-8a30-bbfd0a95c713 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Refreshing instance network info cache due to event network-changed-689b06a2-b41d-4e79-9ad2-b345e07a26d6. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8d37441c-edfe-4dc6-90f3-7ac9fc637a05 req-d5df9e85-5c6d-481e-8a30-bbfd0a95c713 service nova] Acquiring lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.network.neutron [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updating instance_info_cache with network_info: [{"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Releasing lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Instance network_info: |[{"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8d37441c-edfe-4dc6-90f3-7ac9fc637a05 req-d5df9e85-5c6d-481e-8a30-bbfd0a95c713 service nova] Acquired lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.network.neutron [req-8d37441c-edfe-4dc6-90f3-7ac9fc637a05 req-d5df9e85-5c6d-481e-8a30-bbfd0a95c713 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Refreshing network info cache for port 689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Start _get_guest_xml network_info=[{"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:26:13 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:26:13 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-435299708',display_name='tempest-TestServerVolumeAttachmentScenario-server-435299708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-435299708',id=50,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfaFksZuUpfupjv3uJ+rR45FbZZm8Br1xaJU6Re4sgMZuFH+qT4AhdhTOzFU1+H9H/c5ds4E9/eYppa37Pb3J7/TgOe1i+f6sYUIhx4Dc82rT3Uwrvi9eJkR8olTGvCUw==',key_name='tempest-keypair-736512180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c52541ee36f04906b3bb28413efbd8ed',ramdisk_id='',reservation_id='r-igs0la6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-6008395',owner_user_name='tempest-TestServerVolumeAttachmentScenario-6008395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:26:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10553688115447f896d71704b1c96058',uuid=cae8e1fa-1ca2-4498-905d-ee7b9ab2440e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Converting VIF {"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=689b06a2-b41d-4e79-9ad2-b345e07a26d6,network=Network(a2e2d53a-dc23-4d87-805e-efb688f66106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689b06a2-b4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.objects.instance [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lazy-loading 'pci_devices' on Instance uuid cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:26:13 user nova-compute[75813]:   <uuid>cae8e1fa-1ca2-4498-905d-ee7b9ab2440e</uuid>
Nov 15 13:26:13 user nova-compute[75813]:   <name>instance-00000032</name>
Nov 15 13:26:13 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:26:13 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:26:13 user nova-compute[75813]:   <metadata>
Nov 15 13:26:13 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:26:13 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:26:13 user nova-compute[75813]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-435299708</nova:name>
Nov 15 13:26:13 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:26:13</nova:creationTime>
Nov 15 13:26:13 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:26:13 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:26:13 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:26:13 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:26:13 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:26:13 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:26:13 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:26:13 user nova-compute[75813]:       <nova:owner>
Nov 15 13:26:13 user nova-compute[75813]:         <nova:user uuid="10553688115447f896d71704b1c96058">tempest-TestServerVolumeAttachmentScenario-6008395-project-member</nova:user>
Nov 15 13:26:13 user nova-compute[75813]:         <nova:project uuid="c52541ee36f04906b3bb28413efbd8ed">tempest-TestServerVolumeAttachmentScenario-6008395</nova:project>
Nov 15 13:26:13 user nova-compute[75813]:       </nova:owner>
Nov 15 13:26:13 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:26:13 user nova-compute[75813]:       <nova:ports>
Nov 15 13:26:13 user nova-compute[75813]:         <nova:port uuid="689b06a2-b41d-4e79-9ad2-b345e07a26d6">
Nov 15 13:26:13 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 13:26:13 user nova-compute[75813]:         </nova:port>
Nov 15 13:26:13 user nova-compute[75813]:       </nova:ports>
Nov 15 13:26:13 user nova-compute[75813]:     </nova:instance>
Nov 15 13:26:13 user nova-compute[75813]:   </metadata>
Nov 15 13:26:13 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:26:13 user nova-compute[75813]:     <system>
Nov 15 13:26:13 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:26:13 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:26:13 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:26:13 user nova-compute[75813]:       <entry name="serial">cae8e1fa-1ca2-4498-905d-ee7b9ab2440e</entry>
Nov 15 13:26:13 user nova-compute[75813]:       <entry name="uuid">cae8e1fa-1ca2-4498-905d-ee7b9ab2440e</entry>
Nov 15 13:26:13 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:26:13 user nova-compute[75813]:     </system>
Nov 15 13:26:13 user nova-compute[75813]:   </sysinfo>
Nov 15 13:26:13 user nova-compute[75813]:   <os>
Nov 15 13:26:13 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:26:13 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:26:13 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:26:13 user nova-compute[75813]:   </os>
Nov 15 13:26:13 user nova-compute[75813]:   <features>
Nov 15 13:26:13 user nova-compute[75813]:     <acpi/>
Nov 15 13:26:13 user nova-compute[75813]:     <apic/>
Nov 15 13:26:13 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:26:13 user nova-compute[75813]:   </features>
Nov 15 13:26:13 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:26:13 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:26:13 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:26:13 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:26:13 user nova-compute[75813]:   </clock>
Nov 15 13:26:13 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:26:13 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:26:13 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:26:13 user nova-compute[75813]:   </cpu>
Nov 15 13:26:13 user nova-compute[75813]:   <devices>
Nov 15 13:26:13 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:26:13 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:26:13 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk"/>
Nov 15 13:26:13 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:26:13 user nova-compute[75813]:     </disk>
Nov 15 13:26:13 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:26:13 user nova-compute[75813]:       <mac address="fa:16:3e:9c:e1:e3"/>
Nov 15 13:26:13 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:26:13 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:26:13 user nova-compute[75813]:       <target dev="tap689b06a2-b4"/>
Nov 15 13:26:13 user nova-compute[75813]:     </interface>
Nov 15 13:26:13 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:26:13 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/console.log" append="off"/>
Nov 15 13:26:13 user nova-compute[75813]:     </serial>
Nov 15 13:26:13 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:26:13 user nova-compute[75813]:     <video>
Nov 15 13:26:13 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:26:13 user nova-compute[75813]:     </video>
Nov 15 13:26:13 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:26:13 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:26:13 user nova-compute[75813]:     </rng>
Nov 15 13:26:13 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:26:13 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:26:13 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:26:13 user nova-compute[75813]:     </memballoon>
Nov 15 13:26:13 user nova-compute[75813]:   </devices>
Nov 15 13:26:13 user nova-compute[75813]: </domain>
Nov 15 13:26:13 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-435299708',display_name='tempest-TestServerVolumeAttachmentScenario-server-435299708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-435299708',id=50,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfaFksZuUpfupjv3uJ+rR45FbZZm8Br1xaJU6Re4sgMZuFH+qT4AhdhTOzFU1+H9H/c5ds4E9/eYppa37Pb3J7/TgOe1i+f6sYUIhx4Dc82rT3Uwrvi9eJkR8olTGvCUw==',key_name='tempest-keypair-736512180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c52541ee36f04906b3bb28413efbd8ed',ramdisk_id='',reservation_id='r-igs0la6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-6008395',owner_user_name='tempest-TestServerVolumeAttachmentScenario-6008395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:26:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10553688115447f896d71704b1c96058',uuid=cae8e1fa-1ca2-4498-905d-ee7b9ab2440e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Converting VIF {"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=689b06a2-b41d-4e79-9ad2-b345e07a26d6,network=Network(a2e2d53a-dc23-4d87-805e-efb688f66106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689b06a2-b4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG os_vif [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=689b06a2-b41d-4e79-9ad2-b345e07a26d6,network=Network(a2e2d53a-dc23-4d87-805e-efb688f66106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689b06a2-b4') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e8cb177-bd45-52b8-bfeb-775a45b0195d', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap689b06a2-b4, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap689b06a2-b4, col_values=(('qos', UUID('c00d8749-c160-42b5-ab4f-ade8a778a299')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap689b06a2-b4, col_values=(('external_ids', {'iface-id': '689b06a2-b41d-4e79-9ad2-b345e07a26d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:e1:e3', 'vm-uuid': 'cae8e1fa-1ca2-4498-905d-ee7b9ab2440e'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:13 user nova-compute[75813]: INFO os_vif [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=689b06a2-b41d-4e79-9ad2-b345e07a26d6,network=Network(a2e2d53a-dc23-4d87-805e-efb688f66106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689b06a2-b4')
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] No VIF found with MAC fa:16:3e:9c:e1:e3, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.network.neutron [req-8d37441c-edfe-4dc6-90f3-7ac9fc637a05 req-d5df9e85-5c6d-481e-8a30-bbfd0a95c713 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updated VIF entry in instance network info cache for port 689b06a2-b41d-4e79-9ad2-b345e07a26d6. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.network.neutron [req-8d37441c-edfe-4dc6-90f3-7ac9fc637a05 req-d5df9e85-5c6d-481e-8a30-bbfd0a95c713 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updating instance_info_cache with network_info: [{"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23031623565626237', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031623565626237', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-8d37441c-edfe-4dc6-90f3-7ac9fc637a05 req-d5df9e85-5c6d-481e-8a30-bbfd0a95c713 service nova] Releasing lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lazy-loading 'flavor' on Instance uuid cd9f4868-0d91-4757-bb5e-520ba33bca94 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:26:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:26:13 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:26:13 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:26:13 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:26:13 user nova-compute[75813]:   <serial>49c0fad0-a2ae-407e-b462-5b635108c9ab</serial>
Nov 15 13:26:13 user nova-compute[75813]: </disk>
Nov 15 13:26:13 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:26:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:26:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:26:14 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] No VIF found with MAC fa:16:3e:36:33:40, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:26:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d534baf8-94c0-4332-a7f4-cf2b7bd5d470 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.087s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:26:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-d6a572ba-362a-4904-8a2b-5e08db08eacb req-71534205-0fd6-4c20-8b18-93d32e23f3e1 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Received event network-vif-plugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:26:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d6a572ba-362a-4904-8a2b-5e08db08eacb req-71534205-0fd6-4c20-8b18-93d32e23f3e1 service nova] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d6a572ba-362a-4904-8a2b-5e08db08eacb req-71534205-0fd6-4c20-8b18-93d32e23f3e1 service nova] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-d6a572ba-362a-4904-8a2b-5e08db08eacb req-71534205-0fd6-4c20-8b18-93d32e23f3e1 service nova] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-d6a572ba-362a-4904-8a2b-5e08db08eacb req-71534205-0fd6-4c20-8b18-93d32e23f3e1 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] No waiting events found dispatching network-vif-plugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:26:15 user nova-compute[75813]: WARNING nova.compute.manager [req-d6a572ba-362a-4904-8a2b-5e08db08eacb req-71534205-0fd6-4c20-8b18-93d32e23f3e1 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Received unexpected event network-vif-plugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 for instance with vm_state building and task_state spawning.
Nov 15 13:26:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:16 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:26:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:26:17 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Instance spawned successfully.
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:26:17 user nova-compute[75813]: INFO nova.compute.manager [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:26:17 user nova-compute[75813]: INFO nova.compute.manager [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Took 6.34 seconds to build instance.
Nov 15 13:26:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-cea48b6c-1cab-4607-86b2-f32e765ea58c tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.443s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-9ab9dd3e-ce88-4789-ae68-c1be2ce5b95e req-4fc2af49-e241-4798-81fb-743c9566654e service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Received event network-vif-plugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9ab9dd3e-ce88-4789-ae68-c1be2ce5b95e req-4fc2af49-e241-4798-81fb-743c9566654e service nova] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9ab9dd3e-ce88-4789-ae68-c1be2ce5b95e req-4fc2af49-e241-4798-81fb-743c9566654e service nova] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9ab9dd3e-ce88-4789-ae68-c1be2ce5b95e req-4fc2af49-e241-4798-81fb-743c9566654e service nova] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:17 user nova-compute[75813]: DEBUG nova.compute.manager [req-9ab9dd3e-ce88-4789-ae68-c1be2ce5b95e req-4fc2af49-e241-4798-81fb-743c9566654e service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] No waiting events found dispatching network-vif-plugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:26:17 user nova-compute[75813]: WARNING nova.compute.manager [req-9ab9dd3e-ce88-4789-ae68-c1be2ce5b95e req-4fc2af49-e241-4798-81fb-743c9566654e service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Received unexpected event network-vif-plugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 for instance with vm_state active and task_state None.
Nov 15 13:26:18 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:26:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:26:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:26:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8876MB free_disk=24.940738677978516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:26:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance cd9f4868-0d91-4757-bb5e-520ba33bca94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:26:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:26:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:26:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:26:23 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:26:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:26:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:26:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:28 user nova-compute[75813]: INFO nova.compute.manager [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Detaching volume 49c0fad0-a2ae-407e-b462-5b635108c9ab
Nov 15 13:26:28 user nova-compute[75813]: INFO nova.virt.block_device [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Attempting to driver detach volume 49c0fad0-a2ae-407e-b462-5b635108c9ab from mountpoint /dev/vdb
Nov 15 13:26:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Attempting to detach device vdb from instance cd9f4868-0d91-4757-bb5e-520ba33bca94 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:26:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:26:28 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:26:28 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:26:28 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:26:28 user nova-compute[75813]:   <serial>49c0fad0-a2ae-407e-b462-5b635108c9ab</serial>
Nov 15 13:26:28 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:26:28 user nova-compute[75813]: </disk>
Nov 15 13:26:28 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:26:29 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Successfully detached device vdb from instance cd9f4868-0d91-4757-bb5e-520ba33bca94 from the persistent domain config.
Nov 15 13:26:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd9f4868-0d91-4757-bb5e-520ba33bca94 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:26:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:26:29 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:26:29 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:26:29 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:26:29 user nova-compute[75813]:   <serial>49c0fad0-a2ae-407e-b462-5b635108c9ab</serial>
Nov 15 13:26:29 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:26:29 user nova-compute[75813]: </disk>
Nov 15 13:26:29 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:26:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd9f4868-0d91-4757-bb5e-520ba33bca94 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:26:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:49 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd9f4868-0d91-4757-bb5e-520ba33bca94 is timed out.
Nov 15 13:26:49 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Successfully detached device vdb from instance cd9f4868-0d91-4757-bb5e-520ba33bca94 from the live domain config.
Nov 15 13:26:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioyOrnEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:26:49 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[73846170-cb7d-488d-87da-d7db14732f3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:26:49 user nova-compute[75813]: No targets found.
Nov 15 13:26:49 user nova-compute[75813]: iSNS:
Nov 15 13:26:49 user nova-compute[75813]: No targets found.
Nov 15 13:26:49 user nova-compute[75813]: STATIC:
Nov 15 13:26:49 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab
Nov 15 13:26:49 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:26:49 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:26:49 user nova-compute[75813]: FIRMWARE:
Nov 15 13:26:49 user nova-compute[75813]: No targets found.
Nov 15 13:26:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:26:49 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:26:49 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6460001c-dfdf-4e64-84c6-97903199c414]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[198e9c77-e1d8-4ed9-9803-b655bf06f822]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab (non-flash)
Nov 15 13:26:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab (non-flash)
Nov 15 13:26:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555008bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[da971af7-f30b-4e98-ad27-14d2c9661eae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7708b1b1-1c25-48cb-a630-6cbbf63f80af]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb48248-64cb-4743-8fa1-55e51558d2b5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ecc5b7-1781-4b94-93ec-fcbb7d8f0da1]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb52354-1b8f-4135-a2ef-fdef683f7c44]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[febeecdc-5e4f-4548-bf43-7bb09b80f396]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab, portal: 172.16.0.220,3260]
Nov 15 13:26:49 user nova-compute[75813]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab, portal: 172.16.0.220,3260] successful.
Nov 15 13:26:49 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[506039b3-79cc-48d4-a56e-1352cd32cd5f]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] <== disconnect_volume: return (275ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:26:49 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG nova.objects.instance [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lazy-loading 'flavor' on Instance uuid cd9f4868-0d91-4757-bb5e-520ba33bca94 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-1dbf062c-d7ac-4a17-ab47-d9219756ba1e tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.644s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.496s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:50 user nova-compute[75813]: INFO nova.compute.manager [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Terminating instance
Nov 15 13:26:50 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-5858232c-ad79-44a4-a198-f294a885fa8c req-b205de3c-b744-413f-ba20-daa7a0aa3ee8 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Received event network-vif-unplugged-211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5858232c-ad79-44a4-a198-f294a885fa8c req-b205de3c-b744-413f-ba20-daa7a0aa3ee8 service nova] Acquiring lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5858232c-ad79-44a4-a198-f294a885fa8c req-b205de3c-b744-413f-ba20-daa7a0aa3ee8 service nova] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-5858232c-ad79-44a4-a198-f294a885fa8c req-b205de3c-b744-413f-ba20-daa7a0aa3ee8 service nova] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-5858232c-ad79-44a4-a198-f294a885fa8c req-b205de3c-b744-413f-ba20-daa7a0aa3ee8 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] No waiting events found dispatching network-vif-unplugged-211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG nova.compute.manager [req-5858232c-ad79-44a4-a198-f294a885fa8c req-b205de3c-b744-413f-ba20-daa7a0aa3ee8 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Received event network-vif-unplugged-211bb75c-45f6-450d-916b-3de2dfb4d71a for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:26:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Instance destroyed successfully.
Nov 15 13:26:51 user nova-compute[75813]: DEBUG nova.objects.instance [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lazy-loading 'resources' on Instance uuid cd9f4868-0d91-4757-bb5e-520ba33bca94 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-288804365',display_name='tempest-VolumesSnapshotTestJSON-instance-288804365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-288804365',id=49,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWY68MhSexov1C68J00eIWusBCfcGZllncpuGQUYCCYU9SNNptsw1l9i92aGAieWc9F1oWRAHWpdRFxe7aFAlD+D25VRJrQt3wfDTCm9nd2jtUUbPhdMc7m7JFeZclUIg==',key_name='tempest-keypair-539809595',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e7634e1eefe424298288ff6eccc5710',ramdisk_id='',reservation_id='r-588jvgvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1381735690',owner_user_name='tempest-VolumesSnapshotTestJSON-1381735690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdb7b2991154ce3a6d20c20d008cdba',uuid=cd9f4868-0d91-4757-bb5e-520ba33bca94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converting VIF {"id": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "address": "fa:16:3e:36:33:40", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211bb75c-45", "ovs_interfaceid": "211bb75c-45f6-450d-916b-3de2dfb4d71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:33:40,bridge_name='br-int',has_traffic_filtering=True,id=211bb75c-45f6-450d-916b-3de2dfb4d71a,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211bb75c-45') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG os_vif [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:33:40,bridge_name='br-int',has_traffic_filtering=True,id=211bb75c-45f6-450d-916b-3de2dfb4d71a,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211bb75c-45') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap211bb75c-45, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d949a24-3853-4f34-a530-39de582aca40) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:26:51 user nova-compute[75813]: INFO os_vif [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:33:40,bridge_name='br-int',has_traffic_filtering=True,id=211bb75c-45f6-450d-916b-3de2dfb4d71a,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211bb75c-45')
Nov 15 13:26:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:49c0fad0-a2ae-407e-b462-5b635108c9ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioyOrnEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:26:51 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:26:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a7efc1c2-51d4-4f29-ac2b-b9f43dcfeb1f]: Unexpected error while running command.
Nov 15 13:26:51 user nova-compute[75813]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 13:26:51 user nova-compute[75813]: Exit code: 21
Nov 15 13:26:51 user nova-compute[75813]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 13:26:51 user nova-compute[75813]: Stderr: '' {{(pid=87167) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 15 13:26:51 user nova-compute[75813]: Traceback (most recent call last):
Nov 15 13:26:51 user nova-compute[75813]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 15 13:26:51 user nova-compute[75813]:     ret = func(*f_args, **f_kwargs)
Nov 15 13:26:51 user nova-compute[75813]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 15 13:26:51 user nova-compute[75813]:     return func(*args, **kwargs)
Nov 15 13:26:51 user nova-compute[75813]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 15 13:26:51 user nova-compute[75813]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 15 13:26:51 user nova-compute[75813]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 15 13:26:51 user nova-compute[75813]:     return putils.execute(on_execute=on_execute,
Nov 15 13:26:51 user nova-compute[75813]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 15 13:26:51 user nova-compute[75813]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 15 13:26:51 user nova-compute[75813]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 15 13:26:51 user nova-compute[75813]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 13:26:51 user nova-compute[75813]: Exit code: 21
Nov 15 13:26:51 user nova-compute[75813]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 13:26:51 user nova-compute[75813]: Stderr: ''
Nov 15 13:26:51 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7efc1c2-51d4-4f29-ac2b-b9f43dcfeb1f]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 15 13:26:51 user nova-compute[75813]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 13:26:51 user nova-compute[75813]: Exit code: 21
Nov 15 13:26:51 user nova-compute[75813]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 13:26:51 user nova-compute[75813]: Stderr: ''
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 15 13:26:51 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi 
Nov 15 13:26:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75813) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.035s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] <== disconnect_volume: return (36ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:26:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Deleting instance files /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94_del
Nov 15 13:26:51 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Deletion of /opt/stack/data/nova/instances/cd9f4868-0d91-4757-bb5e-520ba33bca94_del complete
Nov 15 13:26:51 user nova-compute[75813]: INFO nova.compute.manager [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 13:26:51 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:26:51 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:26:52 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:26:52 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Took 0.77 seconds to deallocate network for instance.
Nov 15 13:26:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-40d38a89-579d-47be-9995-832080c98cae req-6739d4dc-4753-4bc2-9fbc-097e4953f268 service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Received event network-vif-deleted-211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:26:52 user nova-compute[75813]: WARNING nova.volume.cinder [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Attachment b5f2315b-4bc2-4132-9766-c587d8f5d262 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b5f2315b-4bc2-4132-9766-c587d8f5d262. (HTTP 404) (Request-ID: req-b2ff2e67-a9a6-4b40-9b64-da25528e57f7)
Nov 15 13:26:52 user nova-compute[75813]: INFO nova.compute.manager [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Took 0.02 seconds to detach 1 volumes for instance.
Nov 15 13:26:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:52 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:26:52 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:26:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:52 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Deleted allocations for instance cd9f4868-0d91-4757-bb5e-520ba33bca94
Nov 15 13:26:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8a9d2b3c-2421-4f25-9d1b-3ac1d347a61a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.987s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-c866b015-324a-4608-98e5-df5d37451d7c req-1a61f936-6e5e-44db-928e-34fa2f26e6dd service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Received event network-vif-plugged-211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:26:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c866b015-324a-4608-98e5-df5d37451d7c req-1a61f936-6e5e-44db-928e-34fa2f26e6dd service nova] Acquiring lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:26:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c866b015-324a-4608-98e5-df5d37451d7c req-1a61f936-6e5e-44db-928e-34fa2f26e6dd service nova] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:26:52 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-c866b015-324a-4608-98e5-df5d37451d7c req-1a61f936-6e5e-44db-928e-34fa2f26e6dd service nova] Lock "cd9f4868-0d91-4757-bb5e-520ba33bca94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:26:52 user nova-compute[75813]: DEBUG nova.compute.manager [req-c866b015-324a-4608-98e5-df5d37451d7c req-1a61f936-6e5e-44db-928e-34fa2f26e6dd service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] No waiting events found dispatching network-vif-plugged-211bb75c-45f6-450d-916b-3de2dfb4d71a {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:26:52 user nova-compute[75813]: WARNING nova.compute.manager [req-c866b015-324a-4608-98e5-df5d37451d7c req-1a61f936-6e5e-44db-928e-34fa2f26e6dd service nova] [instance: cd9f4868-0d91-4757-bb5e-520ba33bca94] Received unexpected event network-vif-plugged-211bb75c-45f6-450d-916b-3de2dfb4d71a for instance with vm_state deleted and task_state None.
Nov 15 13:26:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:27:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:27:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:27:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:27:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:27:09 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:27:10 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:27:10 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:27:10 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:27:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:27:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:27:10 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:27:10 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:27:10 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updating instance_info_cache with network_info: [{"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:27:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:27:10 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:27:11 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:27:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:27:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:27:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:27:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:27:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:12 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:27:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:27:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:17 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:27:19 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:27:19 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:27:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:27:22 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:27:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:27:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:27:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:27:22 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:27:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:27:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:27:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:27:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:27:22 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:27:22 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:27:22 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8943MB free_disk=24.93193817138672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:27:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:27:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:27:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:27:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:27:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:27:23 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:27:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:27:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:27:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:27:25 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:27:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:27:31 user nova-compute[75813]: INFO nova.compute.claims [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Claim successful on node user
Nov 15 13:27:31 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG nova.network.neutron [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:27:31 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:27:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG nova.policy [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbdb7b2991154ce3a6d20c20d008cdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7634e1eefe424298288ff6eccc5710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG nova.compute.manager [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:27:31 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Creating image(s)
Nov 15 13:27:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "/opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "/opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "/opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:27:31 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.166s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk 1073741824" returned: 0 in 0.057s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG nova.network.neutron [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Successfully created port: d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Cannot resize image /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Ensure instance console log exists: /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG nova.network.neutron [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Successfully updated port: d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquired lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG nova.network.neutron [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-b1761ccd-b558-426a-810b-c0ba1bb9e5a3 req-d024b60a-3936-4889-96ba-6648e2a1f4a0 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Received event network-changed-d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG nova.compute.manager [req-b1761ccd-b558-426a-810b-c0ba1bb9e5a3 req-d024b60a-3936-4889-96ba-6648e2a1f4a0 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Refreshing instance network info cache due to event network-changed-d8eb76d9-da16-4091-a84f-bfa1232f4059. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:27:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b1761ccd-b558-426a-810b-c0ba1bb9e5a3 req-d024b60a-3936-4889-96ba-6648e2a1f4a0 service nova] Acquiring lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.network.neutron [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.network.neutron [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Updating instance_info_cache with network_info: [{"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Releasing lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.compute.manager [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Instance network_info: |[{"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b1761ccd-b558-426a-810b-c0ba1bb9e5a3 req-d024b60a-3936-4889-96ba-6648e2a1f4a0 service nova] Acquired lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.network.neutron [req-b1761ccd-b558-426a-810b-c0ba1bb9e5a3 req-d024b60a-3936-4889-96ba-6648e2a1f4a0 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Refreshing network info cache for port d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Start _get_guest_xml network_info=[{"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:27:33 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:27:33 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1465590310',display_name='tempest-VolumesSnapshotTestJSON-instance-1465590310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1465590310',id=51,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDVBDg9H4XN6oa/34DHI3GdvE/Uxf5emzRkrWxWmDV161E2SZKg+20KFa7O0tumE8MrMBVBcqSk2+le8QiEJj+JrGDQJxloNG24oQccxiPCLrk2F3j6ZzJOV2uxuRerdA==',key_name='tempest-keypair-207354632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e7634e1eefe424298288ff6eccc5710',ramdisk_id='',reservation_id='r-iwgqfenf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1381735690',owner_user_name='tempest-VolumesSnapshotTestJSON-1381735690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdb7b2991154ce3a6d20c20d008cdba',uuid=1091c4eb-67b3-474b-a5b1-bc540aac78c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converting VIF {"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=d8eb76d9-da16-4091-a84f-bfa1232f4059,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8eb76d9-da') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.objects.instance [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lazy-loading 'pci_devices' on Instance uuid 1091c4eb-67b3-474b-a5b1-bc540aac78c4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:27:33 user nova-compute[75813]:   <uuid>1091c4eb-67b3-474b-a5b1-bc540aac78c4</uuid>
Nov 15 13:27:33 user nova-compute[75813]:   <name>instance-00000033</name>
Nov 15 13:27:33 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:27:33 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:27:33 user nova-compute[75813]:   <metadata>
Nov 15 13:27:33 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:27:33 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:27:33 user nova-compute[75813]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1465590310</nova:name>
Nov 15 13:27:33 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:27:33</nova:creationTime>
Nov 15 13:27:33 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:27:33 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:27:33 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:27:33 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:27:33 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:27:33 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:27:33 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:27:33 user nova-compute[75813]:       <nova:owner>
Nov 15 13:27:33 user nova-compute[75813]:         <nova:user uuid="cbdb7b2991154ce3a6d20c20d008cdba">tempest-VolumesSnapshotTestJSON-1381735690-project-member</nova:user>
Nov 15 13:27:33 user nova-compute[75813]:         <nova:project uuid="6e7634e1eefe424298288ff6eccc5710">tempest-VolumesSnapshotTestJSON-1381735690</nova:project>
Nov 15 13:27:33 user nova-compute[75813]:       </nova:owner>
Nov 15 13:27:33 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:27:33 user nova-compute[75813]:       <nova:ports>
Nov 15 13:27:33 user nova-compute[75813]:         <nova:port uuid="d8eb76d9-da16-4091-a84f-bfa1232f4059">
Nov 15 13:27:33 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 13:27:33 user nova-compute[75813]:         </nova:port>
Nov 15 13:27:33 user nova-compute[75813]:       </nova:ports>
Nov 15 13:27:33 user nova-compute[75813]:     </nova:instance>
Nov 15 13:27:33 user nova-compute[75813]:   </metadata>
Nov 15 13:27:33 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:27:33 user nova-compute[75813]:     <system>
Nov 15 13:27:33 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:27:33 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:27:33 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:27:33 user nova-compute[75813]:       <entry name="serial">1091c4eb-67b3-474b-a5b1-bc540aac78c4</entry>
Nov 15 13:27:33 user nova-compute[75813]:       <entry name="uuid">1091c4eb-67b3-474b-a5b1-bc540aac78c4</entry>
Nov 15 13:27:33 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:27:33 user nova-compute[75813]:     </system>
Nov 15 13:27:33 user nova-compute[75813]:   </sysinfo>
Nov 15 13:27:33 user nova-compute[75813]:   <os>
Nov 15 13:27:33 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:27:33 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:27:33 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:27:33 user nova-compute[75813]:   </os>
Nov 15 13:27:33 user nova-compute[75813]:   <features>
Nov 15 13:27:33 user nova-compute[75813]:     <acpi/>
Nov 15 13:27:33 user nova-compute[75813]:     <apic/>
Nov 15 13:27:33 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:27:33 user nova-compute[75813]:   </features>
Nov 15 13:27:33 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:27:33 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:27:33 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:27:33 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:27:33 user nova-compute[75813]:   </clock>
Nov 15 13:27:33 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:27:33 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:27:33 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:27:33 user nova-compute[75813]:   </cpu>
Nov 15 13:27:33 user nova-compute[75813]:   <devices>
Nov 15 13:27:33 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:27:33 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:27:33 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk"/>
Nov 15 13:27:33 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:27:33 user nova-compute[75813]:     </disk>
Nov 15 13:27:33 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:27:33 user nova-compute[75813]:       <mac address="fa:16:3e:06:d5:2c"/>
Nov 15 13:27:33 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:27:33 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:27:33 user nova-compute[75813]:       <target dev="tapd8eb76d9-da"/>
Nov 15 13:27:33 user nova-compute[75813]:     </interface>
Nov 15 13:27:33 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:27:33 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/console.log" append="off"/>
Nov 15 13:27:33 user nova-compute[75813]:     </serial>
Nov 15 13:27:33 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:27:33 user nova-compute[75813]:     <video>
Nov 15 13:27:33 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:27:33 user nova-compute[75813]:     </video>
Nov 15 13:27:33 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:27:33 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:27:33 user nova-compute[75813]:     </rng>
Nov 15 13:27:33 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:27:33 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:27:33 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:27:33 user nova-compute[75813]:     </memballoon>
Nov 15 13:27:33 user nova-compute[75813]:   </devices>
Nov 15 13:27:33 user nova-compute[75813]: </domain>
Nov 15 13:27:33 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1465590310',display_name='tempest-VolumesSnapshotTestJSON-instance-1465590310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1465590310',id=51,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDVBDg9H4XN6oa/34DHI3GdvE/Uxf5emzRkrWxWmDV161E2SZKg+20KFa7O0tumE8MrMBVBcqSk2+le8QiEJj+JrGDQJxloNG24oQccxiPCLrk2F3j6ZzJOV2uxuRerdA==',key_name='tempest-keypair-207354632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e7634e1eefe424298288ff6eccc5710',ramdisk_id='',reservation_id='r-iwgqfenf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1381735690',owner_user_name='tempest-VolumesSnapshotTestJSON-1381735690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdb7b2991154ce3a6d20c20d008cdba',uuid=1091c4eb-67b3-474b-a5b1-bc540aac78c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converting VIF {"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=d8eb76d9-da16-4091-a84f-bfa1232f4059,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8eb76d9-da') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG os_vif [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=d8eb76d9-da16-4091-a84f-bfa1232f4059,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8eb76d9-da') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eab0c0af-2c79-55cd-a1e3-a550cf5d95d5', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8eb76d9-da, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8eb76d9-da, col_values=(('qos', UUID('58c632cd-59ca-4437-b624-e714c0b856ce')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8eb76d9-da, col_values=(('external_ids', {'iface-id': 'd8eb76d9-da16-4091-a84f-bfa1232f4059', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:d5:2c', 'vm-uuid': '1091c4eb-67b3-474b-a5b1-bc540aac78c4'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:33 user nova-compute[75813]: INFO os_vif [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=d8eb76d9-da16-4091-a84f-bfa1232f4059,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8eb76d9-da')
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] No VIF found with MAC fa:16:3e:06:d5:2c, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.network.neutron [req-b1761ccd-b558-426a-810b-c0ba1bb9e5a3 req-d024b60a-3936-4889-96ba-6648e2a1f4a0 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Updated VIF entry in instance network info cache for port d8eb76d9-da16-4091-a84f-bfa1232f4059. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG nova.network.neutron [req-b1761ccd-b558-426a-810b-c0ba1bb9e5a3 req-d024b60a-3936-4889-96ba-6648e2a1f4a0 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Updating instance_info_cache with network_info: [{"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:27:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-b1761ccd-b558-426a-810b-c0ba1bb9e5a3 req-d024b60a-3936-4889-96ba-6648e2a1f4a0 service nova] Releasing lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:27:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:34 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Received event network-vif-plugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:27:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] Acquiring lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:27:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:27:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:27:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] No waiting events found dispatching network-vif-plugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:27:35 user nova-compute[75813]: WARNING nova.compute.manager [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Received unexpected event network-vif-plugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 for instance with vm_state building and task_state spawning.
Nov 15 13:27:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Received event network-vif-plugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:27:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] Acquiring lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:27:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:27:35 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:27:35 user nova-compute[75813]: DEBUG nova.compute.manager [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] No waiting events found dispatching network-vif-plugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:27:35 user nova-compute[75813]: WARNING nova.compute.manager [req-15052c50-2abd-40ac-80fc-e748c64d6274 req-734aedc8-ca86-49e0-8cbe-074985175a12 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Received unexpected event network-vif-plugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 for instance with vm_state building and task_state spawning.
Nov 15 13:27:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:36 user nova-compute[75813]: DEBUG nova.compute.manager [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:27:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:27:36 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Instance spawned successfully.
Nov 15 13:27:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:27:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:27:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:27:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:27:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:27:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:27:36 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:27:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:36 user nova-compute[75813]: INFO nova.compute.manager [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 15 13:27:36 user nova-compute[75813]: DEBUG nova.compute.manager [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:27:36 user nova-compute[75813]: INFO nova.compute.manager [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Took 5.53 seconds to build instance.
Nov 15 13:27:36 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-be85fe1c-c86a-4121-984f-2b8d9c564080 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.628s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:27:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:27:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:27:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:27:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:27:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:27:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-0cc33e97-ee5d-4a0a-87ab-6d28807872ae req-8373515c-6f78-4686-8314-ace431084ea9 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Received event network-changed-689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-0cc33e97-ee5d-4a0a-87ab-6d28807872ae req-8373515c-6f78-4686-8314-ace431084ea9 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Refreshing instance network info cache due to event network-changed-689b06a2-b41d-4e79-9ad2-b345e07a26d6. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0cc33e97-ee5d-4a0a-87ab-6d28807872ae req-8373515c-6f78-4686-8314-ace431084ea9 service nova] Acquiring lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0cc33e97-ee5d-4a0a-87ab-6d28807872ae req-8373515c-6f78-4686-8314-ace431084ea9 service nova] Acquired lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG nova.network.neutron [req-0cc33e97-ee5d-4a0a-87ab-6d28807872ae req-8373515c-6f78-4686-8314-ace431084ea9 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Refreshing network info cache for port 689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG nova.network.neutron [req-0cc33e97-ee5d-4a0a-87ab-6d28807872ae req-8373515c-6f78-4686-8314-ace431084ea9 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updated VIF entry in instance network info cache for port 689b06a2-b41d-4e79-9ad2-b345e07a26d6. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG nova.network.neutron [req-0cc33e97-ee5d-4a0a-87ab-6d28807872ae req-8373515c-6f78-4686-8314-ace431084ea9 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updating instance_info_cache with network_info: [{"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0cc33e97-ee5d-4a0a-87ab-6d28807872ae req-8373515c-6f78-4686-8314-ace431084ea9 service nova] Releasing lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG nova.objects.instance [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lazy-loading 'flavor' on Instance uuid cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:28:02 user nova-compute[75813]: INFO nova.compute.manager [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Attaching volume ff285e60-fc12-4099-892c-f9b0af0d7d78 to /dev/vdb
Nov 15 13:28:02 user nova-compute[75813]: DEBUG os_brick.utils [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee26349-1c17-4f00-808f-8150fecdd542]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed87f49-cd66-4b93-b78f-58ad9c39865d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5167078-1b71-4050-8456-81a1cf7a135e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[792ceb35-3968-400d-bfe4-9bb07a5b1142]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:28:03 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:28:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf76b6ea-dd95-40fd-9835-fd9904c97684]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG os_brick.utils [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updating existing volume attachment record: 7d58e43b-acd8-481b-acaf-f18c2a117198 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:28:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiuKXtQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:28:07 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:28:07 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:28:07 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e500c-84c1-426a-837d-015cf5181b1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:28:07 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a81d492-f8f1-4f35-bed8-a41d9d06fe76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78] added
Nov 15 13:28:07 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9582fc49-a888-44b9-9278-530be1fa8cb8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb89c47-708d-4a7f-95d4-0ee9a0eda080]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiuKXtQe {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiuKXtQe" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9848e46-64d8-4186-ad26-de76c840f66e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YiuKXtQe'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d129e0-d00c-4bce-8f47-cfab41ffc3b5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b472025-36c1-477c-be97-8562270dd883]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:28:07 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:28:07 user nova-compute[75813]:  {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:28:07 user nova-compute[75813]: WARNING os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 13:28:07 user nova-compute[75813]: 
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faa52e7-8809-43c1-8f56-ff3238eda827]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78, portal: 172.16.0.220,3260]
Nov 15 13:28:07 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78, portal: 172.16.0.220,3260] successful.
Nov 15 13:28:07 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc9b53d-55d6-47e0-8529-a397dcc0ffa2]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ffe21f-7045-4329-8d32-758af6a2b472]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:28:07 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:28:07 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0947fd-b681-4de8-a800-87a6f7f1cbde]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:28:07 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiuKXtQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:28:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:28:08 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26635376238666236', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:28:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635376238666236', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:28:08 user nova-compute[75813]: DEBUG nova.objects.instance [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lazy-loading 'flavor' on Instance uuid cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:28:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:28:08 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:28:08 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:28:08 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:28:08 user nova-compute[75813]:   <serial>ff285e60-fc12-4099-892c-f9b0af0d7d78</serial>
Nov 15 13:28:08 user nova-compute[75813]: </disk>
Nov 15 13:28:08 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:28:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:28:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:28:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] No VIF found with MAC fa:16:3e:9c:e1:e3, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:28:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-16670b39-ea9a-4124-84b7-a644a66cdf0d tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.499s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:28:10 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updating instance_info_cache with network_info: [{"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:28:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG nova.objects.instance [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lazy-loading 'flavor' on Instance uuid cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:28:13 user nova-compute[75813]: INFO nova.compute.manager [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Attaching volume 83c04910-852d-4df9-a6a5-2d2907b2d537 to /dev/vdc
Nov 15 13:28:13 user nova-compute[75813]: DEBUG os_brick.utils [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a824500a-4e7e-4e41-b573-bc5f33301cd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd83eb04-055e-4b5d-812f-f1abc5e4e88d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[164dcedd-951d-42d9-b40d-19d31ae547c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b47bbd5-4a3e-43c9-9d77-e862df406345]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:28:13 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:28:13 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ea149e-ab5e-47fb-b24d-4c95aa19e9f1]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG os_brick.utils [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:28:13 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updating existing volume attachment record: eddc8dfc-c120-4370-8942-0ca78f1cc38f {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:28:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBKNZIML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:28:18 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:28:18 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:28:18 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ab9309-fd20-4086-a2d1-4d7e8d2e4374]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:28:18 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b471ec0-8f49-4ddf-89af-4c7472839012]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537] added
Nov 15 13:28:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9588d5cb-15f5-4d7d-a60b-d80db4813d44]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d58459-ffc2-49bd-83df-c0f6f20fb8e8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBKNZIML {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBKNZIML" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad13bbe9-7ed4-467a-a6bb-895d96f5205a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cBKNZIML'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01073bb-7341-4f4e-b977-77265a253d72]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f193ea8-7c3d-46b4-92d5-d355d11ad673]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:28:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:28:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c679b226-fe57-4534-9cd7-556b94868def]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537, portal: 172.16.0.220,3260]
Nov 15 13:28:18 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537, portal: 172.16.0.220,3260] successful.
Nov 15 13:28:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ee412f-4dbb-4655-bd72-b688e998b9e2]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e2c6c3-f78f-4397-b98b-2abbefae2d23]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:28:18 user nova-compute[75813]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 (non-flash)
Nov 15 13:28:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:28:18 user nova-compute[75813]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 (non-flash)
Nov 15 13:28:18 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a04c5b-4ab0-4f0b-848c-0143caa642bf]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:28:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBKNZIML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:28:19 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:28:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:28:19 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26239313436323763', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:28:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239313436323763', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:28:19 user nova-compute[75813]: DEBUG nova.objects.instance [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lazy-loading 'flavor' on Instance uuid cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:28:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:28:19 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:28:19 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:28:19 user nova-compute[75813]:   <target dev="vdc" bus="virtio"/>
Nov 15 13:28:19 user nova-compute[75813]:   <serial>83c04910-852d-4df9-a6a5-2d2907b2d537</serial>
Nov 15 13:28:19 user nova-compute[75813]: </disk>
Nov 15 13:28:19 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:28:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:28:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:28:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:28:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] No VIF found with MAC fa:16:3e:9c:e1:e3, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:28:20 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:28:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-b57a3dca-aed9-4781-8ee4-9eeb37ec231f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.530s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:28:21 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:28:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:28:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:28:21 user nova-compute[75813]: INFO nova.compute.manager [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Detaching volume 83c04910-852d-4df9-a6a5-2d2907b2d537
Nov 15 13:28:21 user nova-compute[75813]: INFO nova.virt.block_device [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Attempting to driver detach volume 83c04910-852d-4df9-a6a5-2d2907b2d537 from mountpoint /dev/vdc
Nov 15 13:28:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Attempting to detach device vdc from instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:28:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:28:21 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:28:21 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:28:21 user nova-compute[75813]:   <target dev="vdc" bus="virtio"/>
Nov 15 13:28:21 user nova-compute[75813]:   <serial>83c04910-852d-4df9-a6a5-2d2907b2d537</serial>
Nov 15 13:28:21 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 13:28:21 user nova-compute[75813]: </disk>
Nov 15 13:28:21 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:28:21 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Successfully detached device vdc from instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e from the persistent domain config.
Nov 15 13:28:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:28:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:28:21 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:28:21 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:28:21 user nova-compute[75813]:   <target dev="vdc" bus="virtio"/>
Nov 15 13:28:21 user nova-compute[75813]:   <serial>83c04910-852d-4df9-a6a5-2d2907b2d537</serial>
Nov 15 13:28:21 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 13:28:21 user nova-compute[75813]: </disk>
Nov 15 13:28:21 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:28:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:22 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75813) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 13:28:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:28:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:28:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=24.90111541748047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 1091c4eb-67b3-474b-a5b1-bc540aac78c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:28:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:28:25 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:28:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:28:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:28:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:41 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e is timed out.
Nov 15 13:28:41 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Successfully detached device vdc from instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e from the live domain config.
Nov 15 13:28:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBKNZIML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:28:41 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:28:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[147872cc-b4a5-4869-a5d8-a0845991cd13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:28:41 user nova-compute[75813]: No targets found.
Nov 15 13:28:41 user nova-compute[75813]: iSNS:
Nov 15 13:28:41 user nova-compute[75813]: No targets found.
Nov 15 13:28:41 user nova-compute[75813]: STATIC:
Nov 15 13:28:41 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78
Nov 15 13:28:41 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:28:41 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:28:41 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537
Nov 15 13:28:41 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:28:41 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:28:41 user nova-compute[75813]: FIRMWARE:
Nov 15 13:28:41 user nova-compute[75813]: No targets found.
Nov 15 13:28:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:28:41 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:28:41 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae1ef86-8928-4448-b617-5bb34bf97f8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdf0640-45be-4767-b05d-d547b8d34af0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:28:42 user nova-compute[75813]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 (non-flash)
Nov 15 13:28:42 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:28:42 user nova-compute[75813]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 (non-flash)
Nov 15 13:28:42 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55504fbf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537'): ({'sdc'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Removing single pathed devices sdc {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d47d3a-1633-428f-a5d9-80c5f3737821]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb53c1a-c24b-4c4c-bcdf-984310ad0c42]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Flushing IO for device /dev/sdc {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a61f647-5b39-41ac-ab8b-3f59dcbee1b7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4410198-9f91-43b9-a77e-3d6805998c9c]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d32ed7-45d0-47bd-abe5-5ddb4260e5f0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e065ab-9131-42c4-8902-f0b88612f912]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537, portal: 172.16.0.220,3260]
Nov 15 13:28:42 user nova-compute[75813]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537, portal: 172.16.0.220,3260] successful.
Nov 15 13:28:42 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c04910-852d-4df9-a6a5-2d2907b2d537 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5437b743-8bcc-472b-a646-9f434429cbe0]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] <== disconnect_volume: return (318ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:28:42 user nova-compute[75813]: DEBUG nova.objects.instance [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lazy-loading 'flavor' on Instance uuid cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:28:43 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-ce3d23cc-8aed-4bd4-984c-792f8901be0f tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.640s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:28:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:28:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:28:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:28:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:28:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:28:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:28:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:28:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:28:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:28:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:28:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:28:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:28:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:28:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:29:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:11 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:11 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:11 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:11 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75813) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 13:29:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:29:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:29:11 user nova-compute[75813]: INFO nova.compute.manager [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Detaching volume ff285e60-fc12-4099-892c-f9b0af0d7d78
Nov 15 13:29:12 user nova-compute[75813]: INFO nova.virt.block_device [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Attempting to driver detach volume ff285e60-fc12-4099-892c-f9b0af0d7d78 from mountpoint /dev/vdb
Nov 15 13:29:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Attempting to detach device vdb from instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:29:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:29:12 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:29:12 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:29:12 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:29:12 user nova-compute[75813]:   <serial>ff285e60-fc12-4099-892c-f9b0af0d7d78</serial>
Nov 15 13:29:12 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:29:12 user nova-compute[75813]: </disk>
Nov 15 13:29:12 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:29:12 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Successfully detached device vdb from instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e from the persistent domain config.
Nov 15 13:29:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:29:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:29:12 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:29:12 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:29:12 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:29:12 user nova-compute[75813]:   <serial>ff285e60-fc12-4099-892c-f9b0af0d7d78</serial>
Nov 15 13:29:12 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:29:12 user nova-compute[75813]: </disk>
Nov 15 13:29:12 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:29:12 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:29:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:29:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:29:12 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:29:12 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:29:12 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Updating instance_info_cache with network_info: [{"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:29:12 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:29:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:29:13 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:29:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:29:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 13:29:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] There are 0 instances to clean {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 13:29:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:29:20 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:20 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:21 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-afcea64d-a73a-44b1-8292-90f7c02bb643 req-6d38979c-18fc-4515-8e19-914afec647f6 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Received event network-changed-d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-afcea64d-a73a-44b1-8292-90f7c02bb643 req-6d38979c-18fc-4515-8e19-914afec647f6 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Refreshing instance network info cache due to event network-changed-d8eb76d9-da16-4091-a84f-bfa1232f4059. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-afcea64d-a73a-44b1-8292-90f7c02bb643 req-6d38979c-18fc-4515-8e19-914afec647f6 service nova] Acquiring lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-afcea64d-a73a-44b1-8292-90f7c02bb643 req-6d38979c-18fc-4515-8e19-914afec647f6 service nova] Acquired lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG nova.network.neutron [req-afcea64d-a73a-44b1-8292-90f7c02bb643 req-6d38979c-18fc-4515-8e19-914afec647f6 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Refreshing network info cache for port d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG nova.objects.instance [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lazy-loading 'flavor' on Instance uuid 1091c4eb-67b3-474b-a5b1-bc540aac78c4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:29:22 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Ignoring supplied device name: /dev/vdb
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:29:22 user nova-compute[75813]: INFO nova.compute.manager [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Attaching volume d6789b46-c45f-4972-9401-c5c09f3fee00 to /dev/vdb
Nov 15 13:29:22 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG os_brick.utils [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:29:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8855MB free_disk=24.900413513183594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e191af-8c6a-457f-8b0c-d4ddbc2e0fd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b175d0-df2e-4a40-a5bb-efb57a5da61d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d93912-36e8-44c2-ad0d-bbbc3312f7fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1159b-e1b0-4a82-b54c-e2dd86669a7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:29:23 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a8ac45-1371-48d5-83b1-bd6b8d16f7cd]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG os_brick.utils [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Updating existing volume attachment record: 730d7979-ace1-4fdd-b426-c5ece5ff61c4 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 1091c4eb-67b3-474b-a5b1-bc540aac78c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing inventories for resource provider 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating ProviderTree inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing aggregate associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, aggregates: None {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.network.neutron [req-afcea64d-a73a-44b1-8292-90f7c02bb643 req-6d38979c-18fc-4515-8e19-914afec647f6 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Updated VIF entry in instance network info cache for port d8eb76d9-da16-4091-a84f-bfa1232f4059. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.network.neutron [req-afcea64d-a73a-44b1-8292-90f7c02bb643 req-6d38979c-18fc-4515-8e19-914afec647f6 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Updating instance_info_cache with network_info: [{"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing trait associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, traits: HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-afcea64d-a73a-44b1-8292-90f7c02bb643 req-6d38979c-18fc-4515-8e19-914afec647f6 service nova] Releasing lock "refresh_cache-1091c4eb-67b3-474b-a5b1-bc540aac78c4" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:29:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:29:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INrqvOte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:29:27 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:29:27 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:29:27 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a94edae-2f3d-4702-802c-7087d5a72dad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:29:27 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb58ea1-59f6-470b-a5a9-f809e0c5e144]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00] added
Nov 15 13:29:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.057s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cabc41-ac33-4270-82df-c6a9189db0b7]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bd3165-4c19-49e6-af06-253b23de1549]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INrqvOte {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INrqvOte" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[096e596c-533b-455f-9f90-64f6068cc351]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'INrqvOte'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[197077ec-63df-45f8-ae0a-60a75c9c7824]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9802962c-f4c5-4a00-8541-c8ea8b0a1a9c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:29:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:29:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:29:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e135ecfa-47a1-4999-b88d-55608bf2af80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00, portal: 172.16.0.220,3260]
Nov 15 13:29:28 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00, portal: 172.16.0.220,3260] successful.
Nov 15 13:29:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[94640b7b-eb51-48fe-96fa-959f3d6b5584]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6f2fb0-985c-4b9a-8ff8-2d4502117159]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:29:28 user nova-compute[75813]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 (non-flash)
Nov 15 13:29:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:29:28 user nova-compute[75813]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 (non-flash)
Nov 15 13:29:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c244331-04fd-4869-b7ea-00bdf5430a76]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INrqvOte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:29:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:29 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:29:29 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26230383862366436', 'path': '/dev/sdc'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:29:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230383862366436', 'path': '/dev/sdc'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:29:29 user nova-compute[75813]: DEBUG nova.objects.instance [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lazy-loading 'flavor' on Instance uuid 1091c4eb-67b3-474b-a5b1-bc540aac78c4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:29:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:29:29 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:29:29 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:29:29 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:29:29 user nova-compute[75813]:   <serial>d6789b46-c45f-4972-9401-c5c09f3fee00</serial>
Nov 15 13:29:29 user nova-compute[75813]: </disk>
Nov 15 13:29:29 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:29:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:29:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:29:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] No VIF found with MAC fa:16:3e:06:d5:2c, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:29:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f1b089f-98e9-4f51-bb7b-1d71ebd0ccc1 tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.783s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:29:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:32 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e is timed out.
Nov 15 13:29:32 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Successfully detached device vdb from instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e from the live domain config.
Nov 15 13:29:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiuKXtQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:29:32 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f80417-4a2f-4099-ab29-4bf88c2bac30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:29:32 user nova-compute[75813]: No targets found.
Nov 15 13:29:32 user nova-compute[75813]: iSNS:
Nov 15 13:29:32 user nova-compute[75813]: No targets found.
Nov 15 13:29:32 user nova-compute[75813]: STATIC:
Nov 15 13:29:32 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78
Nov 15 13:29:32 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:29:32 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:29:32 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00
Nov 15 13:29:32 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:29:32 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:29:32 user nova-compute[75813]: FIRMWARE:
Nov 15 13:29:32 user nova-compute[75813]: No targets found.
Nov 15 13:29:32 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:29:32 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:29:32 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1124698-6251-41bb-b16d-fde73ef56820]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d37f59-819d-4126-88bf-ef6905c748b9]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:29:32 user nova-compute[75813]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 (non-flash)
Nov 15 13:29:32 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 (non-flash)
Nov 15 13:29:32 user nova-compute[75813]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 (non-flash)
Nov 15 13:29:32 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555042e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[58371aa8-22f5-459c-8a92-89ddca3c509b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb446dd-5077-4ae3-abcd-b4c8b8f0f35a]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3257d00d-8c38-4735-8f4a-246438ef8b31]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7814000d-6cb1-4aaa-869d-4456a84be8bc]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6668e3c5-56cb-4515-b838-f817eae9a23a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[326a6ec4-1893-4db4-b920-df13dc800bb9]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78, portal: 172.16.0.220,3260]
Nov 15 13:29:32 user nova-compute[75813]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78, portal: 172.16.0.220,3260] successful.
Nov 15 13:29:32 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff285e60-fc12-4099-892c-f9b0af0d7d78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db413a1-88d7-46d9-9932-3fc570a662ab]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] <== disconnect_volume: return (304ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:29:32 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:29:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:33 user nova-compute[75813]: DEBUG nova.objects.instance [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lazy-loading 'flavor' on Instance uuid cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:29:33 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-2eb4845a-52bf-4f58-90f1-21e02f533496 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.632s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:29:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:29:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:29:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:29:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:29:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:29:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:29:39 user nova-compute[75813]: INFO nova.compute.manager [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Detaching volume d6789b46-c45f-4972-9401-c5c09f3fee00
Nov 15 13:29:39 user nova-compute[75813]: INFO nova.virt.block_device [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Attempting to driver detach volume d6789b46-c45f-4972-9401-c5c09f3fee00 from mountpoint /dev/vdb
Nov 15 13:29:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Attempting to detach device vdb from instance 1091c4eb-67b3-474b-a5b1-bc540aac78c4 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:29:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:29:39 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:29:39 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:29:39 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:29:39 user nova-compute[75813]:   <serial>d6789b46-c45f-4972-9401-c5c09f3fee00</serial>
Nov 15 13:29:39 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:29:39 user nova-compute[75813]: </disk>
Nov 15 13:29:39 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:29:39 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Successfully detached device vdb from instance 1091c4eb-67b3-474b-a5b1-bc540aac78c4 from the persistent domain config.
Nov 15 13:29:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1091c4eb-67b3-474b-a5b1-bc540aac78c4 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:29:39 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:29:39 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:29:39 user nova-compute[75813]:   <source dev="/dev/sdc"/>
Nov 15 13:29:39 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:29:39 user nova-compute[75813]:   <serial>d6789b46-c45f-4972-9401-c5c09f3fee00</serial>
Nov 15 13:29:39 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:29:39 user nova-compute[75813]: </disk>
Nov 15 13:29:39 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:29:39 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:29:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1091c4eb-67b3-474b-a5b1-bc540aac78c4 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:29:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:29:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:29:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:29:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:29:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:29:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:00 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1091c4eb-67b3-474b-a5b1-bc540aac78c4 is timed out.
Nov 15 13:30:00 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Successfully detached device vdb from instance 1091c4eb-67b3-474b-a5b1-bc540aac78c4 from the live domain config.
Nov 15 13:30:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INrqvOte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:30:00 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[896f4b43-ee2a-445a-8580-d951aef64c9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:30:00 user nova-compute[75813]: No targets found.
Nov 15 13:30:00 user nova-compute[75813]: iSNS:
Nov 15 13:30:00 user nova-compute[75813]: No targets found.
Nov 15 13:30:00 user nova-compute[75813]: STATIC:
Nov 15 13:30:00 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00
Nov 15 13:30:00 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:30:00 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:30:00 user nova-compute[75813]: FIRMWARE:
Nov 15 13:30:00 user nova-compute[75813]: No targets found.
Nov 15 13:30:00 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:30:00 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:30:00 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d44ab58-da66-4812-8f93-4d5a5dddb753]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a286b2d-955f-43f1-a266-120006878032]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 (non-flash)
Nov 15 13:30:00 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 (non-flash)
Nov 15 13:30:00 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555042e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00'): ({'sdc'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Removing single pathed devices sdc {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7c401b-71f0-42fd-9040-be1d677890e9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe296fb-e644-42dc-a27a-b2781bdb19e0]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Flushing IO for device /dev/sdc {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f81fd8e-c8b9-4e14-8f3e-95961338c5e5]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ff9ad2-6d85-42cf-8f29-762376f09e20]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] SCSI volumes sdc have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d0bcd3-7e02-45b1-891b-3cca7eba391c]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da2cbae-b7da-4d2a-ae97-f39a791f3d2a]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00, portal: 172.16.0.220,3260]
Nov 15 13:30:00 user nova-compute[75813]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00, portal: 172.16.0.220,3260] successful.
Nov 15 13:30:00 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd60eea-eba4-4138-9b95-6dfc58351020]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] <== disconnect_volume: return (346ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:30:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG nova.objects.instance [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lazy-loading 'flavor' on Instance uuid 1091c4eb-67b3-474b-a5b1-bc540aac78c4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e4f08911-ed12-478c-9339-9ec29108350a tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.760s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.620s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:01 user nova-compute[75813]: INFO nova.compute.manager [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Terminating instance
Nov 15 13:30:01 user nova-compute[75813]: DEBUG nova.compute.manager [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-65aca1cb-a13b-4110-9cde-fa5b287c0006 req-8f72a56a-1991-4268-b741-12cd2d2e0ca4 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Received event network-vif-unplugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-65aca1cb-a13b-4110-9cde-fa5b287c0006 req-8f72a56a-1991-4268-b741-12cd2d2e0ca4 service nova] Acquiring lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-65aca1cb-a13b-4110-9cde-fa5b287c0006 req-8f72a56a-1991-4268-b741-12cd2d2e0ca4 service nova] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-65aca1cb-a13b-4110-9cde-fa5b287c0006 req-8f72a56a-1991-4268-b741-12cd2d2e0ca4 service nova] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-65aca1cb-a13b-4110-9cde-fa5b287c0006 req-8f72a56a-1991-4268-b741-12cd2d2e0ca4 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] No waiting events found dispatching network-vif-unplugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG nova.compute.manager [req-65aca1cb-a13b-4110-9cde-fa5b287c0006 req-8f72a56a-1991-4268-b741-12cd2d2e0ca4 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Received event network-vif-unplugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:30:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Instance destroyed successfully.
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.objects.instance [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lazy-loading 'resources' on Instance uuid 1091c4eb-67b3-474b-a5b1-bc540aac78c4 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1465590310',display_name='tempest-VolumesSnapshotTestJSON-instance-1465590310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1465590310',id=51,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDVBDg9H4XN6oa/34DHI3GdvE/Uxf5emzRkrWxWmDV161E2SZKg+20KFa7O0tumE8MrMBVBcqSk2+le8QiEJj+JrGDQJxloNG24oQccxiPCLrk2F3j6ZzJOV2uxuRerdA==',key_name='tempest-keypair-207354632',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:27:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e7634e1eefe424298288ff6eccc5710',ramdisk_id='',reservation_id='r-iwgqfenf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1381735690',owner_user_name='tempest-VolumesSnapshotTestJSON-1381735690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdb7b2991154ce3a6d20c20d008cdba',uuid=1091c4eb-67b3-474b-a5b1-bc540aac78c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converting VIF {"id": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "address": "fa:16:3e:06:d5:2c", "network": {"id": "4bdddba8-c6b1-41fa-99b4-f04c9f79047d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37319056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7634e1eefe424298288ff6eccc5710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8eb76d9-da", "ovs_interfaceid": "d8eb76d9-da16-4091-a84f-bfa1232f4059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=d8eb76d9-da16-4091-a84f-bfa1232f4059,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8eb76d9-da') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG os_vif [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=d8eb76d9-da16-4091-a84f-bfa1232f4059,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8eb76d9-da') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8eb76d9-da, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58c632cd-59ca-4437-b624-e714c0b856ce) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:30:02 user nova-compute[75813]: INFO os_vif [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:d5:2c,bridge_name='br-int',has_traffic_filtering=True,id=d8eb76d9-da16-4091-a84f-bfa1232f4059,network=Network(4bdddba8-c6b1-41fa-99b4-f04c9f79047d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8eb76d9-da')
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d6789b46-c45f-4972-9401-c5c09f3fee00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INrqvOte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:30:02 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:30:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[0372bb4b-9ab7-43cf-8a32-c249e64337a2]: Unexpected error while running command.
Nov 15 13:30:02 user nova-compute[75813]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 13:30:02 user nova-compute[75813]: Exit code: 21
Nov 15 13:30:02 user nova-compute[75813]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 13:30:02 user nova-compute[75813]: Stderr: '' {{(pid=87167) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 15 13:30:02 user nova-compute[75813]: Traceback (most recent call last):
Nov 15 13:30:02 user nova-compute[75813]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 15 13:30:02 user nova-compute[75813]:     ret = func(*f_args, **f_kwargs)
Nov 15 13:30:02 user nova-compute[75813]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 15 13:30:02 user nova-compute[75813]:     return func(*args, **kwargs)
Nov 15 13:30:02 user nova-compute[75813]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 15 13:30:02 user nova-compute[75813]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 15 13:30:02 user nova-compute[75813]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 15 13:30:02 user nova-compute[75813]:     return putils.execute(on_execute=on_execute,
Nov 15 13:30:02 user nova-compute[75813]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 15 13:30:02 user nova-compute[75813]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 15 13:30:02 user nova-compute[75813]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 15 13:30:02 user nova-compute[75813]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 13:30:02 user nova-compute[75813]: Exit code: 21
Nov 15 13:30:02 user nova-compute[75813]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 13:30:02 user nova-compute[75813]: Stderr: ''
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0372bb4b-9ab7-43cf-8a32-c249e64337a2]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 15 13:30:02 user nova-compute[75813]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 13:30:02 user nova-compute[75813]: Exit code: 21
Nov 15 13:30:02 user nova-compute[75813]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 13:30:02 user nova-compute[75813]: Stderr: ''
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 15 13:30:02 user nova-compute[75813]: ERROR os_brick.initiator.connectors.iscsi 
Nov 15 13:30:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75813) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.024s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] <== disconnect_volume: return (25ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:30:02 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Deleting instance files /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4_del
Nov 15 13:30:02 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Deletion of /opt/stack/data/nova/instances/1091c4eb-67b3-474b-a5b1-bc540aac78c4_del complete
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:02 user nova-compute[75813]: INFO nova.compute.manager [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Terminating instance
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.compute.manager [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:30:02 user nova-compute[75813]: INFO nova.compute.manager [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-ecb88a12-6720-445e-91af-79a7f865f3fa req-c9d94aeb-a661-46a2-87d7-17e81637a371 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Received event network-vif-unplugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ecb88a12-6720-445e-91af-79a7f865f3fa req-c9d94aeb-a661-46a2-87d7-17e81637a371 service nova] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ecb88a12-6720-445e-91af-79a7f865f3fa req-c9d94aeb-a661-46a2-87d7-17e81637a371 service nova] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ecb88a12-6720-445e-91af-79a7f865f3fa req-c9d94aeb-a661-46a2-87d7-17e81637a371 service nova] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-ecb88a12-6720-445e-91af-79a7f865f3fa req-c9d94aeb-a661-46a2-87d7-17e81637a371 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] No waiting events found dispatching network-vif-unplugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:30:02 user nova-compute[75813]: DEBUG nova.compute.manager [req-ecb88a12-6720-445e-91af-79a7f865f3fa req-c9d94aeb-a661-46a2-87d7-17e81637a371 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Received event network-vif-unplugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:03 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Instance destroyed successfully.
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.objects.instance [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lazy-loading 'resources' on Instance uuid cae8e1fa-1ca2-4498-905d-ee7b9ab2440e {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:26:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-435299708',display_name='tempest-TestServerVolumeAttachmentScenario-server-435299708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-435299708',id=50,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfaFksZuUpfupjv3uJ+rR45FbZZm8Br1xaJU6Re4sgMZuFH+qT4AhdhTOzFU1+H9H/c5ds4E9/eYppa37Pb3J7/TgOe1i+f6sYUIhx4Dc82rT3Uwrvi9eJkR8olTGvCUw==',key_name='tempest-keypair-736512180',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:26:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c52541ee36f04906b3bb28413efbd8ed',ramdisk_id='',reservation_id='r-igs0la6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-6008395',owner_user_name='tempest-TestServerVolumeAttachmentScenario-6008395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:26:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10553688115447f896d71704b1c96058',uuid=cae8e1fa-1ca2-4498-905d-ee7b9ab2440e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Converting VIF {"id": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "address": "fa:16:3e:9c:e1:e3", "network": {"id": "a2e2d53a-dc23-4d87-805e-efb688f66106", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1341956567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c52541ee36f04906b3bb28413efbd8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689b06a2-b4", "ovs_interfaceid": "689b06a2-b41d-4e79-9ad2-b345e07a26d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=689b06a2-b41d-4e79-9ad2-b345e07a26d6,network=Network(a2e2d53a-dc23-4d87-805e-efb688f66106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689b06a2-b4') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG os_vif [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=689b06a2-b41d-4e79-9ad2-b345e07a26d6,network=Network(a2e2d53a-dc23-4d87-805e-efb688f66106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689b06a2-b4') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap689b06a2-b4, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c00d8749-c160-42b5-ab4f-ade8a778a299) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:30:03 user nova-compute[75813]: INFO os_vif [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=689b06a2-b41d-4e79-9ad2-b345e07a26d6,network=Network(a2e2d53a-dc23-4d87-805e-efb688f66106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689b06a2-b4')
Nov 15 13:30:03 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Deleting instance files /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e_del
Nov 15 13:30:03 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Deletion of /opt/stack/data/nova/instances/cae8e1fa-1ca2-4498-905d-ee7b9ab2440e_del complete
Nov 15 13:30:03 user nova-compute[75813]: INFO nova.compute.manager [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 13:30:03 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:30:03 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Took 1.24 seconds to deallocate network for instance.
Nov 15 13:30:03 user nova-compute[75813]: WARNING nova.volume.cinder [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Attachment 730d7979-ace1-4fdd-b426-c5ece5ff61c4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 730d7979-ace1-4fdd-b426-c5ece5ff61c4. (HTTP 404) (Request-ID: req-7a7ae75e-882b-498f-a331-8acdae3ea2d2)
Nov 15 13:30:03 user nova-compute[75813]: INFO nova.compute.manager [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Took 0.02 seconds to detach 1 volumes for instance.
Nov 15 13:30:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-bc34f857-5a99-4889-9ee3-ca92cac9adc3 req-32e56260-31e6-4dff-9393-b0e5c1a962c1 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Received event network-vif-plugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bc34f857-5a99-4889-9ee3-ca92cac9adc3 req-32e56260-31e6-4dff-9393-b0e5c1a962c1 service nova] Acquiring lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bc34f857-5a99-4889-9ee3-ca92cac9adc3 req-32e56260-31e6-4dff-9393-b0e5c1a962c1 service nova] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-bc34f857-5a99-4889-9ee3-ca92cac9adc3 req-32e56260-31e6-4dff-9393-b0e5c1a962c1 service nova] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-bc34f857-5a99-4889-9ee3-ca92cac9adc3 req-32e56260-31e6-4dff-9393-b0e5c1a962c1 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] No waiting events found dispatching network-vif-plugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:30:03 user nova-compute[75813]: WARNING nova.compute.manager [req-bc34f857-5a99-4889-9ee3-ca92cac9adc3 req-32e56260-31e6-4dff-9393-b0e5c1a962c1 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Received unexpected event network-vif-plugged-d8eb76d9-da16-4091-a84f-bfa1232f4059 for instance with vm_state deleted and task_state None.
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.compute.manager [req-bc34f857-5a99-4889-9ee3-ca92cac9adc3 req-32e56260-31e6-4dff-9393-b0e5c1a962c1 service nova] [instance: 1091c4eb-67b3-474b-a5b1-bc540aac78c4] Received event network-vif-deleted-d8eb76d9-da16-4091-a84f-bfa1232f4059 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:30:03 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Deleted allocations for instance 1091c4eb-67b3-474b-a5b1-bc540aac78c4
Nov 15 13:30:03 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:30:03 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Took 0.75 seconds to deallocate network for instance.
Nov 15 13:30:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-e71e25e1-b239-49a5-9017-2580c9d53bfe tempest-VolumesSnapshotTestJSON-1381735690 tempest-VolumesSnapshotTestJSON-1381735690-project-member] Lock "1091c4eb-67b3-474b-a5b1-bc540aac78c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.529s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:30:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:04 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:30:04 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:30:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:04 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Deleted allocations for instance cae8e1fa-1ca2-4498-905d-ee7b9ab2440e
Nov 15 13:30:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-90e0664a-9570-4b47-987c-95a5eaae2960 tempest-TestServerVolumeAttachmentScenario-6008395 tempest-TestServerVolumeAttachmentScenario-6008395-project-member] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.879s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-278b7993-3398-486b-91af-e94e3681ace9 req-ba7241d3-ca58-49fd-8722-890fa2556ab5 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Received event network-vif-plugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:30:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-278b7993-3398-486b-91af-e94e3681ace9 req-ba7241d3-ca58-49fd-8722-890fa2556ab5 service nova] Acquiring lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:30:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-278b7993-3398-486b-91af-e94e3681ace9 req-ba7241d3-ca58-49fd-8722-890fa2556ab5 service nova] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-278b7993-3398-486b-91af-e94e3681ace9 req-ba7241d3-ca58-49fd-8722-890fa2556ab5 service nova] Lock "cae8e1fa-1ca2-4498-905d-ee7b9ab2440e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-278b7993-3398-486b-91af-e94e3681ace9 req-ba7241d3-ca58-49fd-8722-890fa2556ab5 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] No waiting events found dispatching network-vif-plugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:30:04 user nova-compute[75813]: WARNING nova.compute.manager [req-278b7993-3398-486b-91af-e94e3681ace9 req-ba7241d3-ca58-49fd-8722-890fa2556ab5 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Received unexpected event network-vif-plugged-689b06a2-b41d-4e79-9ad2-b345e07a26d6 for instance with vm_state deleted and task_state None.
Nov 15 13:30:04 user nova-compute[75813]: DEBUG nova.compute.manager [req-278b7993-3398-486b-91af-e94e3681ace9 req-ba7241d3-ca58-49fd-8722-890fa2556ab5 service nova] [instance: cae8e1fa-1ca2-4498-905d-ee7b9ab2440e] Received event network-vif-deleted-689b06a2-b41d-4e79-9ad2-b345e07a26d6 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:30:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:11 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:30:12 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:30:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:30:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:30:12 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 13:30:13 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:30:13 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:30:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:30:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:30:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:30:21 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:30:22 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:30:22 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:30:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:30:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9100MB free_disk=24.95486831665039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:30:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:30:26 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:30:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:30:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:30:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:30:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:30:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:30:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:30:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:30:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:30:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:13 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:31:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:31:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:31:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 13:31:13 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:31:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:31:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:31:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:31:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:31:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:31:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:31:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:31:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:31:18 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:31:18 user nova-compute[75813]: INFO nova.compute.claims [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Claim successful on node user
Nov 15 13:31:19 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.183s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG nova.network.neutron [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:31:19 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:31:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG nova.policy [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '072d6f7219aa456ba52b4dfd9554c4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882bdeb9a854607bf39c0cc45fe1512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:31:19 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Creating image(s)
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "/opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "/opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.170s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.168s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk 1073741824" returned: 0 in 0.063s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:31:19 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Successfully created port: de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Cannot resize image /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Ensure instance console log exists: /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Successfully updated port: de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquired lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-cca6f3a2-15d2-4b9b-a89d-9b505d83ce63 req-145d19e7-b4cf-4f5c-af16-12e92ef9ac71 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-changed-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.compute.manager [req-cca6f3a2-15d2-4b9b-a89d-9b505d83ce63 req-145d19e7-b4cf-4f5c-af16-12e92ef9ac71 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Refreshing instance network info cache due to event network-changed-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cca6f3a2-15d2-4b9b-a89d-9b505d83ce63 req-145d19e7-b4cf-4f5c-af16-12e92ef9ac71 service nova] Acquiring lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updating instance_info_cache with network_info: [{"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Releasing lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Instance network_info: |[{"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cca6f3a2-15d2-4b9b-a89d-9b505d83ce63 req-145d19e7-b4cf-4f5c-af16-12e92ef9ac71 service nova] Acquired lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.network.neutron [req-cca6f3a2-15d2-4b9b-a89d-9b505d83ce63 req-145d19e7-b4cf-4f5c-af16-12e92ef9ac71 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Refreshing network info cache for port de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Start _get_guest_xml network_info=[{"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:31:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:31:20 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:31:20 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-19837958',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-19837958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1983795',id=52,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOslKsymbh/OGd2YfQbCLYR4Z14zEpLNyewo9IfXW1qOo3NZY2Ld7LEf3MmfcQXw4O+0TJMWRNUz25B398QhFQmON0lpa2S4lzxTsfhi1AW7vDCW5lGPf1fD42BfXFq9lw==',key_name='tempest-keypair-1091838569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f882bdeb9a854607bf39c0cc45fe1512',ramdisk_id='',reservation_id='r-5857aj8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1727141636',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:31:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072d6f7219aa456ba52b4dfd9554c4fe',uuid=2ce88645-2926-422c-916d-ab3518004176,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Converting VIF {"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9d:38,bridge_name='br-int',has_traffic_filtering=True,id=de591a4f-a0e6-42b5-b2d7-21b6ea6145c3,network=Network(36ac51c0-1663-44e5-9067-4ca36b07cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde591a4f-a0') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.objects.instance [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ce88645-2926-422c-916d-ab3518004176 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:31:21 user nova-compute[75813]:   <uuid>2ce88645-2926-422c-916d-ab3518004176</uuid>
Nov 15 13:31:21 user nova-compute[75813]:   <name>instance-00000034</name>
Nov 15 13:31:21 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:31:21 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:31:21 user nova-compute[75813]:   <metadata>
Nov 15 13:31:21 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:31:21 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:31:21 user nova-compute[75813]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-19837958</nova:name>
Nov 15 13:31:21 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:31:20</nova:creationTime>
Nov 15 13:31:21 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:31:21 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:31:21 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:31:21 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:31:21 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:31:21 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:31:21 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:31:21 user nova-compute[75813]:       <nova:owner>
Nov 15 13:31:21 user nova-compute[75813]:         <nova:user uuid="072d6f7219aa456ba52b4dfd9554c4fe">tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member</nova:user>
Nov 15 13:31:21 user nova-compute[75813]:         <nova:project uuid="f882bdeb9a854607bf39c0cc45fe1512">tempest-TestServerVolumeAttachScenarioOldVersion-1727141636</nova:project>
Nov 15 13:31:21 user nova-compute[75813]:       </nova:owner>
Nov 15 13:31:21 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:31:21 user nova-compute[75813]:       <nova:ports>
Nov 15 13:31:21 user nova-compute[75813]:         <nova:port uuid="de591a4f-a0e6-42b5-b2d7-21b6ea6145c3">
Nov 15 13:31:21 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 13:31:21 user nova-compute[75813]:         </nova:port>
Nov 15 13:31:21 user nova-compute[75813]:       </nova:ports>
Nov 15 13:31:21 user nova-compute[75813]:     </nova:instance>
Nov 15 13:31:21 user nova-compute[75813]:   </metadata>
Nov 15 13:31:21 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:31:21 user nova-compute[75813]:     <system>
Nov 15 13:31:21 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:31:21 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:31:21 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:31:21 user nova-compute[75813]:       <entry name="serial">2ce88645-2926-422c-916d-ab3518004176</entry>
Nov 15 13:31:21 user nova-compute[75813]:       <entry name="uuid">2ce88645-2926-422c-916d-ab3518004176</entry>
Nov 15 13:31:21 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:31:21 user nova-compute[75813]:     </system>
Nov 15 13:31:21 user nova-compute[75813]:   </sysinfo>
Nov 15 13:31:21 user nova-compute[75813]:   <os>
Nov 15 13:31:21 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:31:21 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:31:21 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:31:21 user nova-compute[75813]:   </os>
Nov 15 13:31:21 user nova-compute[75813]:   <features>
Nov 15 13:31:21 user nova-compute[75813]:     <acpi/>
Nov 15 13:31:21 user nova-compute[75813]:     <apic/>
Nov 15 13:31:21 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:31:21 user nova-compute[75813]:   </features>
Nov 15 13:31:21 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:31:21 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:31:21 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:31:21 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:31:21 user nova-compute[75813]:   </clock>
Nov 15 13:31:21 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:31:21 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:31:21 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:31:21 user nova-compute[75813]:   </cpu>
Nov 15 13:31:21 user nova-compute[75813]:   <devices>
Nov 15 13:31:21 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:31:21 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:31:21 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk"/>
Nov 15 13:31:21 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:31:21 user nova-compute[75813]:     </disk>
Nov 15 13:31:21 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:31:21 user nova-compute[75813]:       <mac address="fa:16:3e:e8:9d:38"/>
Nov 15 13:31:21 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:31:21 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:31:21 user nova-compute[75813]:       <target dev="tapde591a4f-a0"/>
Nov 15 13:31:21 user nova-compute[75813]:     </interface>
Nov 15 13:31:21 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:31:21 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/console.log" append="off"/>
Nov 15 13:31:21 user nova-compute[75813]:     </serial>
Nov 15 13:31:21 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:31:21 user nova-compute[75813]:     <video>
Nov 15 13:31:21 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:31:21 user nova-compute[75813]:     </video>
Nov 15 13:31:21 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:31:21 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:31:21 user nova-compute[75813]:     </rng>
Nov 15 13:31:21 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:31:21 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:31:21 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:31:21 user nova-compute[75813]:     </memballoon>
Nov 15 13:31:21 user nova-compute[75813]:   </devices>
Nov 15 13:31:21 user nova-compute[75813]: </domain>
Nov 15 13:31:21 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-19837958',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-19837958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1983795',id=52,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOslKsymbh/OGd2YfQbCLYR4Z14zEpLNyewo9IfXW1qOo3NZY2Ld7LEf3MmfcQXw4O+0TJMWRNUz25B398QhFQmON0lpa2S4lzxTsfhi1AW7vDCW5lGPf1fD42BfXFq9lw==',key_name='tempest-keypair-1091838569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f882bdeb9a854607bf39c0cc45fe1512',ramdisk_id='',reservation_id='r-5857aj8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1727141636',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:31:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072d6f7219aa456ba52b4dfd9554c4fe',uuid=2ce88645-2926-422c-916d-ab3518004176,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Converting VIF {"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9d:38,bridge_name='br-int',has_traffic_filtering=True,id=de591a4f-a0e6-42b5-b2d7-21b6ea6145c3,network=Network(36ac51c0-1663-44e5-9067-4ca36b07cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde591a4f-a0') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG os_vif [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9d:38,bridge_name='br-int',has_traffic_filtering=True,id=de591a4f-a0e6-42b5-b2d7-21b6ea6145c3,network=Network(36ac51c0-1663-44e5-9067-4ca36b07cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde591a4f-a0') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86445c66-41a4-531b-9bc9-f3a415b0ec17', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde591a4f-a0, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde591a4f-a0, col_values=(('qos', UUID('09337588-d2a1-40cd-a82a-91817937a24d')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde591a4f-a0, col_values=(('external_ids', {'iface-id': 'de591a4f-a0e6-42b5-b2d7-21b6ea6145c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:9d:38', 'vm-uuid': '2ce88645-2926-422c-916d-ab3518004176'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:21 user nova-compute[75813]: INFO os_vif [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9d:38,bridge_name='br-int',has_traffic_filtering=True,id=de591a4f-a0e6-42b5-b2d7-21b6ea6145c3,network=Network(36ac51c0-1663-44e5-9067-4ca36b07cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde591a4f-a0')
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] No VIF found with MAC fa:16:3e:e8:9d:38, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.network.neutron [req-cca6f3a2-15d2-4b9b-a89d-9b505d83ce63 req-145d19e7-b4cf-4f5c-af16-12e92ef9ac71 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updated VIF entry in instance network info cache for port de591a4f-a0e6-42b5-b2d7-21b6ea6145c3. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG nova.network.neutron [req-cca6f3a2-15d2-4b9b-a89d-9b505d83ce63 req-145d19e7-b4cf-4f5c-af16-12e92ef9ac71 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updating instance_info_cache with network_info: [{"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-cca6f3a2-15d2-4b9b-a89d-9b505d83ce63 req-145d19e7-b4cf-4f5c-af16-12e92ef9ac71 service nova] Releasing lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:31:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:22 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:31:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-0321db02-dfb6-4de3-b390-519063f9ba92 req-3b3fb4fc-e76e-4fb5-a97a-6f1650d51ec1 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:31:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0321db02-dfb6-4de3-b390-519063f9ba92 req-3b3fb4fc-e76e-4fb5-a97a-6f1650d51ec1 service nova] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:31:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0321db02-dfb6-4de3-b390-519063f9ba92 req-3b3fb4fc-e76e-4fb5-a97a-6f1650d51ec1 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:31:22 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0321db02-dfb6-4de3-b390-519063f9ba92 req-3b3fb4fc-e76e-4fb5-a97a-6f1650d51ec1 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:31:22 user nova-compute[75813]: DEBUG nova.compute.manager [req-0321db02-dfb6-4de3-b390-519063f9ba92 req-3b3fb4fc-e76e-4fb5-a97a-6f1650d51ec1 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] No waiting events found dispatching network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:31:22 user nova-compute[75813]: WARNING nova.compute.manager [req-0321db02-dfb6-4de3-b390-519063f9ba92 req-3b3fb4fc-e76e-4fb5-a97a-6f1650d51ec1 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received unexpected event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 for instance with vm_state building and task_state spawning.
Nov 15 13:31:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:22 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:31:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:31:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:31:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9082MB free_disk=24.943096160888672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:31:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2ce88645-2926-422c-916d-ab3518004176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.compute.manager [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:31:24 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 2ce88645-2926-422c-916d-ab3518004176] Instance spawned successfully.
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-a3e54c2a-c740-4f90-bb3a-f98c90080e95 req-3bb0144f-56e7-41f3-bc48-e45b588e8dda service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a3e54c2a-c740-4f90-bb3a-f98c90080e95 req-3bb0144f-56e7-41f3-bc48-e45b588e8dda service nova] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a3e54c2a-c740-4f90-bb3a-f98c90080e95 req-3bb0144f-56e7-41f3-bc48-e45b588e8dda service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a3e54c2a-c740-4f90-bb3a-f98c90080e95 req-3bb0144f-56e7-41f3-bc48-e45b588e8dda service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.compute.manager [req-a3e54c2a-c740-4f90-bb3a-f98c90080e95 req-3bb0144f-56e7-41f3-bc48-e45b588e8dda service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] No waiting events found dispatching network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:31:24 user nova-compute[75813]: WARNING nova.compute.manager [req-a3e54c2a-c740-4f90-bb3a-f98c90080e95 req-3bb0144f-56e7-41f3-bc48-e45b588e8dda service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received unexpected event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 for instance with vm_state building and task_state spawning.
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:31:24 user nova-compute[75813]: INFO nova.compute.manager [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 15 13:31:24 user nova-compute[75813]: DEBUG nova.compute.manager [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:31:24 user nova-compute[75813]: INFO nova.compute.manager [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Took 5.79 seconds to build instance.
Nov 15 13:31:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-15ddd2e1-e9a1-4899-a49f-23317cde7463 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.886s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:31:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:28 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:31:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:31:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:31:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:31:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:31:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:31:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:32:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:14 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:32:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:32:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:32:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:32:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:32:14 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2ce88645-2926-422c-916d-ab3518004176] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:32:14 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid 2ce88645-2926-422c-916d-ab3518004176 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:32:14 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updating instance_info_cache with network_info: [{"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:32:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:32:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:32:14 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:32:16 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:32:16 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:32:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:32:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:32:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:32:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:32:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:32:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:32:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:22 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:32:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:32:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:32:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:32:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:32:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:32:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:32:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:32:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:32:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:32:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:32:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:32:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=24.914348602294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:32:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:32:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:32:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2ce88645-2926-422c-916d-ab3518004176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:32:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:32:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:32:24 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:32:24 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:32:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:32:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:32:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:32:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:32:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:32:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:32:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:26 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:32:26 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:32:26 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:32:28 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:32:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:32:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:32:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:32:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:32:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:32:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:32:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:32:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:32:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:32:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:32:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:32:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:33:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-2084ad37-5a98-4380-9899-66a7e16016a1 req-d82d15d7-55ea-45d2-82d1-b25cf9bb72f7 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-changed-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:33:09 user nova-compute[75813]: DEBUG nova.compute.manager [req-2084ad37-5a98-4380-9899-66a7e16016a1 req-d82d15d7-55ea-45d2-82d1-b25cf9bb72f7 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Refreshing instance network info cache due to event network-changed-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:33:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2084ad37-5a98-4380-9899-66a7e16016a1 req-d82d15d7-55ea-45d2-82d1-b25cf9bb72f7 service nova] Acquiring lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:33:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2084ad37-5a98-4380-9899-66a7e16016a1 req-d82d15d7-55ea-45d2-82d1-b25cf9bb72f7 service nova] Acquired lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:33:09 user nova-compute[75813]: DEBUG nova.network.neutron [req-2084ad37-5a98-4380-9899-66a7e16016a1 req-d82d15d7-55ea-45d2-82d1-b25cf9bb72f7 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Refreshing network info cache for port de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:33:10 user nova-compute[75813]: DEBUG nova.network.neutron [req-2084ad37-5a98-4380-9899-66a7e16016a1 req-d82d15d7-55ea-45d2-82d1-b25cf9bb72f7 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updated VIF entry in instance network info cache for port de591a4f-a0e6-42b5-b2d7-21b6ea6145c3. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:33:10 user nova-compute[75813]: DEBUG nova.network.neutron [req-2084ad37-5a98-4380-9899-66a7e16016a1 req-d82d15d7-55ea-45d2-82d1-b25cf9bb72f7 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updating instance_info_cache with network_info: [{"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:33:10 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-2084ad37-5a98-4380-9899-66a7e16016a1 req-d82d15d7-55ea-45d2-82d1-b25cf9bb72f7 service nova] Releasing lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG nova.objects.instance [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lazy-loading 'flavor' on Instance uuid 2ce88645-2926-422c-916d-ab3518004176 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:33:11 user nova-compute[75813]: INFO nova.compute.manager [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Attaching volume 734032b9-d02f-4ae0-83da-39ccbcfb170d to /dev/vdb
Nov 15 13:33:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG os_brick.utils [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:33:11 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dc0d4a-4ab9-494d-b2ce-3c9d0c3c269e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[af92f53d-a5ee-4131-8eb9-71d330276a53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c84639-9cbf-43f3-8597-9500d3c52239]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0d0869-1125-4376-8bdc-c7fea5d7c072]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:33:12 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:33:12 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2787d61-7126-48ee-9d88-9969ebc74ac0]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG os_brick.utils [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:33:12 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updating existing volume attachment record: f2731b30-4f7c-4959-bf0b-b0cf0b2d9cc1 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:33:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:33:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:33:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:33:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:33:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:33:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2ce88645-2926-422c-916d-ab3518004176] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:33:15 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid 2ce88645-2926-422c-916d-ab3518004176 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:33:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updating instance_info_cache with network_info: [{"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:33:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:33:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:33:16 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:33:16 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:33:16 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:33:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqmOzKJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:33:17 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:33:17 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:33:17 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc70de4-c0f2-43d4-b33d-3619e0503f76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:33:17 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b48688c-2255-4e5d-b766-6aa8f91c1063]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d] added
Nov 15 13:33:17 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d317d728-95c7-4447-bb09-a37d0379691d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d058566-7acc-455c-8a21-8f57520dc959]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqmOzKJD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqmOzKJD" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fadb624-3e8b-453f-9385-48b936e81132]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vqmOzKJD'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5056401-3f97-4f8b-8217-62dd2831ba70]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7657b899-e12c-4028-ad27-25ffdd37cf1d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:33:17 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:33:17 user nova-compute[75813]:  {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:33:17 user nova-compute[75813]: WARNING os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 13:33:17 user nova-compute[75813]: 
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9774ea-721d-4392-808b-e48e707484d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d, portal: 172.16.0.220,3260]
Nov 15 13:33:17 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d, portal: 172.16.0.220,3260] successful.
Nov 15 13:33:17 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc76c9-bd66-4245-b2d4-99d769a33ffa]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9369a265-e612-47dc-a0fe-5c406f18d60c]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d (non-flash)
Nov 15 13:33:17 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d (non-flash)
Nov 15 13:33:17 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[530349d3-ead8-42a9-a9ba-fedae71c48e9]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:17 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:33:18 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:33:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqmOzKJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:33:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:33:18 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23766663139646461', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:33:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766663139646461', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:33:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lazy-loading 'flavor' on Instance uuid 2ce88645-2926-422c-916d-ab3518004176 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:33:18 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:33:18 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:33:18 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:33:18 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:33:18 user nova-compute[75813]:   <serial>734032b9-d02f-4ae0-83da-39ccbcfb170d</serial>
Nov 15 13:33:18 user nova-compute[75813]: </disk>
Nov 15 13:33:18 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:33:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:33:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:33:19 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] No VIF found with MAC fa:16:3e:e8:9d:38, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:33:19 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-f3388588-75e9-47f8-8c14-df87bf5606fa tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.373s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:33:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:33:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:33:20 user nova-compute[75813]: INFO nova.compute.manager [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Detaching volume 734032b9-d02f-4ae0-83da-39ccbcfb170d
Nov 15 13:33:20 user nova-compute[75813]: INFO nova.virt.block_device [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Attempting to driver detach volume 734032b9-d02f-4ae0-83da-39ccbcfb170d from mountpoint /dev/vdb
Nov 15 13:33:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Attempting to detach device vdb from instance 2ce88645-2926-422c-916d-ab3518004176 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:33:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:33:20 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:33:20 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:33:20 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:33:20 user nova-compute[75813]:   <serial>734032b9-d02f-4ae0-83da-39ccbcfb170d</serial>
Nov 15 13:33:20 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:33:20 user nova-compute[75813]: </disk>
Nov 15 13:33:20 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:33:20 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Successfully detached device vdb from instance 2ce88645-2926-422c-916d-ab3518004176 from the persistent domain config.
Nov 15 13:33:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ce88645-2926-422c-916d-ab3518004176 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:33:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:33:20 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:33:20 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:33:20 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:33:20 user nova-compute[75813]:   <serial>734032b9-d02f-4ae0-83da-39ccbcfb170d</serial>
Nov 15 13:33:20 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:33:20 user nova-compute[75813]: </disk>
Nov 15 13:33:20 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:33:20 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ce88645-2926-422c-916d-ab3518004176 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:33:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:33:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:33:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=24.913249969482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:33:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:33:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance 2ce88645-2926-422c-916d-ab3518004176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:33:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:33:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:33:24 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:33:24 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:33:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:33:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:33:26 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:33:26 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:33:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:33:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:33:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:33:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:33:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:29 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:33:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:40 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2ce88645-2926-422c-916d-ab3518004176 is timed out.
Nov 15 13:33:40 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Successfully detached device vdb from instance 2ce88645-2926-422c-916d-ab3518004176 from the live domain config.
Nov 15 13:33:40 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqmOzKJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:33:40 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0edbd2-457f-4cb0-be61-085317d1acff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:33:40 user nova-compute[75813]: No targets found.
Nov 15 13:33:40 user nova-compute[75813]: iSNS:
Nov 15 13:33:40 user nova-compute[75813]: No targets found.
Nov 15 13:33:40 user nova-compute[75813]: STATIC:
Nov 15 13:33:40 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d
Nov 15 13:33:40 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:33:40 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:33:40 user nova-compute[75813]: FIRMWARE:
Nov 15 13:33:40 user nova-compute[75813]: No targets found.
Nov 15 13:33:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:33:40 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:33:40 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb80aed-05b6-4c6d-a9af-188931a921f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fc8f28-77e6-494d-8e23-d49125aeaabe]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d (non-flash)
Nov 15 13:33:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d (non-flash)
Nov 15 13:33:40 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f555488e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c27895-c8f5-481e-97b1-aa91516798ad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d187163-5dd1-4035-80ce-808f84e14c13]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6673cc1-8e68-4d85-a4d0-4fcc6c6c9d4e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6204153f-4e38-413f-a1aa-20efe7ec4507]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:33:40 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9713a161-77ad-4046-b973-4e50597bcf4e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc66bea-154c-4af6-9da6-83a9818e6cb3]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d, portal: 172.16.0.220,3260]
Nov 15 13:33:41 user nova-compute[75813]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d, portal: 172.16.0.220,3260] successful.
Nov 15 13:33:41 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734032b9-d02f-4ae0-83da-39ccbcfb170d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61eb47e-e3fe-4d67-af6f-35a23e97dc94]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] <== disconnect_volume: return (280ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG nova.objects.instance [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lazy-loading 'flavor' on Instance uuid 2ce88645-2926-422c-916d-ab3518004176 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-fed6b762-cb98-4a18-893a-5fbceaa153d9 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.611s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:33:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:33:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:33:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:34:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:34:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:34:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:34:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:34:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:34:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:34:13 user nova-compute[75813]: INFO nova.compute.manager [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Terminating instance
Nov 15 13:34:13 user nova-compute[75813]: DEBUG nova.compute.manager [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-0b2bee4a-0ea2-4618-bca2-0af3e1b45751 req-54a781ec-41a9-43a1-a63e-f97915a3ccac service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-vif-unplugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0b2bee4a-0ea2-4618-bca2-0af3e1b45751 req-54a781ec-41a9-43a1-a63e-f97915a3ccac service nova] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0b2bee4a-0ea2-4618-bca2-0af3e1b45751 req-54a781ec-41a9-43a1-a63e-f97915a3ccac service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-0b2bee4a-0ea2-4618-bca2-0af3e1b45751 req-54a781ec-41a9-43a1-a63e-f97915a3ccac service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-0b2bee4a-0ea2-4618-bca2-0af3e1b45751 req-54a781ec-41a9-43a1-a63e-f97915a3ccac service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] No waiting events found dispatching network-vif-unplugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG nova.compute.manager [req-0b2bee4a-0ea2-4618-bca2-0af3e1b45751 req-54a781ec-41a9-43a1-a63e-f97915a3ccac service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-vif-unplugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: 2ce88645-2926-422c-916d-ab3518004176] Instance destroyed successfully.
Nov 15 13:34:13 user nova-compute[75813]: DEBUG nova.objects.instance [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lazy-loading 'resources' on Instance uuid 2ce88645-2926-422c-916d-ab3518004176 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-19837958',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-19837958',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1983795',id=52,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOslKsymbh/OGd2YfQbCLYR4Z14zEpLNyewo9IfXW1qOo3NZY2Ld7LEf3MmfcQXw4O+0TJMWRNUz25B398QhFQmON0lpa2S4lzxTsfhi1AW7vDCW5lGPf1fD42BfXFq9lw==',key_name='tempest-keypair-1091838569',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:31:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f882bdeb9a854607bf39c0cc45fe1512',ramdisk_id='',reservation_id='r-5857aj8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1727141636',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:31:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072d6f7219aa456ba52b4dfd9554c4fe',uuid=2ce88645-2926-422c-916d-ab3518004176,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Converting VIF {"id": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "address": "fa:16:3e:e8:9d:38", "network": {"id": "36ac51c0-1663-44e5-9067-4ca36b07cfea", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2025936567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f882bdeb9a854607bf39c0cc45fe1512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde591a4f-a0", "ovs_interfaceid": "de591a4f-a0e6-42b5-b2d7-21b6ea6145c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:9d:38,bridge_name='br-int',has_traffic_filtering=True,id=de591a4f-a0e6-42b5-b2d7-21b6ea6145c3,network=Network(36ac51c0-1663-44e5-9067-4ca36b07cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde591a4f-a0') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG os_vif [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:9d:38,bridge_name='br-int',has_traffic_filtering=True,id=de591a4f-a0e6-42b5-b2d7-21b6ea6145c3,network=Network(36ac51c0-1663-44e5-9067-4ca36b07cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde591a4f-a0') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde591a4f-a0, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09337588-d2a1-40cd-a82a-91817937a24d) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:34:13 user nova-compute[75813]: INFO os_vif [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:9d:38,bridge_name='br-int',has_traffic_filtering=True,id=de591a4f-a0e6-42b5-b2d7-21b6ea6145c3,network=Network(36ac51c0-1663-44e5-9067-4ca36b07cfea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde591a4f-a0')
Nov 15 13:34:13 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Deleting instance files /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176_del
Nov 15 13:34:13 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Deletion of /opt/stack/data/nova/instances/2ce88645-2926-422c-916d-ab3518004176_del complete
Nov 15 13:34:13 user nova-compute[75813]: INFO nova.compute.manager [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] [instance: 2ce88645-2926-422c-916d-ab3518004176] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 13:34:13 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: 2ce88645-2926-422c-916d-ab3518004176] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:34:13 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 2ce88645-2926-422c-916d-ab3518004176] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:34:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:14 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:34:14 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: 2ce88645-2926-422c-916d-ab3518004176] Took 1.01 seconds to deallocate network for instance.
Nov 15 13:34:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-54b701aa-d3a3-4203-bdd4-fead156333cc req-a4a4ce74-6a2e-4f74-9151-9e7c06a8427e service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-vif-deleted-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:34:15 user nova-compute[75813]: INFO nova.compute.manager [req-54b701aa-d3a3-4203-bdd4-fead156333cc req-a4a4ce74-6a2e-4f74-9151-9e7c06a8427e service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Neutron deleted interface de591a4f-a0e6-42b5-b2d7-21b6ea6145c3; detaching it from the instance and deleting it from the info cache
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.network.neutron [req-54b701aa-d3a3-4203-bdd4-fead156333cc req-a4a4ce74-6a2e-4f74-9151-9e7c06a8427e service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-54b701aa-d3a3-4203-bdd4-fead156333cc req-a4a4ce74-6a2e-4f74-9151-9e7c06a8427e service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Detach interface failed, port_id=de591a4f-a0e6-42b5-b2d7-21b6ea6145c3, reason: Instance 2ce88645-2926-422c-916d-ab3518004176 could not be found. {{(pid=75813) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2ce88645-2926-422c-916d-ab3518004176] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid 2ce88645-2926-422c-916d-ab3518004176 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:34:15 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Deleted allocations for instance 2ce88645-2926-422c-916d-ab3518004176
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2ce88645-2926-422c-916d-ab3518004176] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-8f7a8857-362c-44f9-a17c-4745b33ca2f1 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636 tempest-TestServerVolumeAttachScenarioOldVersion-1727141636-project-member] Lock "2ce88645-2926-422c-916d-ab3518004176" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.242s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-2ce88645-2926-422c-916d-ab3518004176" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: 2ce88645-2926-422c-916d-ab3518004176] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] There are 0 instances to clean {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] No waiting events found dispatching network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:34:15 user nova-compute[75813]: WARNING nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received unexpected event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 for instance with vm_state deleted and task_state None.
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] No waiting events found dispatching network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:34:15 user nova-compute[75813]: WARNING nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received unexpected event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 for instance with vm_state deleted and task_state None.
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] No waiting events found dispatching network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:34:15 user nova-compute[75813]: WARNING nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received unexpected event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 for instance with vm_state deleted and task_state None.
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-vif-unplugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] No waiting events found dispatching network-vif-unplugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:34:15 user nova-compute[75813]: WARNING nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received unexpected event network-vif-unplugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 for instance with vm_state deleted and task_state None.
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Acquiring lock "2ce88645-2926-422c-916d-ab3518004176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] Lock "2ce88645-2926-422c-916d-ab3518004176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:34:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] No waiting events found dispatching network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:34:15 user nova-compute[75813]: WARNING nova.compute.manager [req-a201a3c6-d84e-42f1-9748-31609a75cefd req-d8d26654-57f0-4969-9fec-48b0db8a0f65 service nova] [instance: 2ce88645-2926-422c-916d-ab3518004176] Received unexpected event network-vif-plugged-de591a4f-a0e6-42b5-b2d7-21b6ea6145c3 for instance with vm_state deleted and task_state None.
Nov 15 13:34:17 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:18 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:18 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:34:18 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75813) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 13:34:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:34:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:34:23 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9121MB free_disk=24.940303802490234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing inventories for resource provider 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating ProviderTree inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing aggregate associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, aggregates: None {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing trait associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, traits: HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:34:23 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:34:24 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:25 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:26 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:26 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:30 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:34:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:34:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:34:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:34:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:36 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:34:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:34:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:34:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:34:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:34:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:52 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:34:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:34:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:34:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:34:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:34:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:34:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:34:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:34:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:34:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:34:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:03 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:09 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:13 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:17 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:35:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:35:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:35:17 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 13:35:17 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:35:18 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:19 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:35:19 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:35:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:35:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:35:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:35:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:35:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:35:23 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:35:24 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:35:24 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:35:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9220MB free_disk=24.93310546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:35:24 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:35:26 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:35:27 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:35:28 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:35:28 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:35:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:35:33 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:38 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:43 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:44 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:48 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:35:53 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:35:53 user nova-compute[75813]: DEBUG nova.compute.manager [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Starting instance... {{(pid=75813) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 13:35:53 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75813) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 13:35:54 user nova-compute[75813]: INFO nova.compute.claims [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Claim successful on node user
Nov 15 13:35:54 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG nova.compute.manager [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Start building networks asynchronously for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG nova.compute.manager [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Allocating IP information in the background. {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG nova.network.neutron [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] allocate_for_instance() {{(pid=75813) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 13:35:54 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 13:35:54 user nova-compute[75813]: DEBUG nova.compute.manager [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Start building block device mappings for instance. {{(pid=75813) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG nova.policy [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '353f21b868974f00864a114102019d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f1ea60311d4370a52f76e5555e80bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75813) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG nova.compute.manager [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Start spawning the instance on the hypervisor. {{(pid=75813) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Creating instance directory {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 13:35:54 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Creating image(s)
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "/opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "/opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.199s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.200s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk 1073741824 {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4,backing_fmt=raw /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk 1073741824" returned: 0 in 0.082s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "9bc394db29c70cccb4e2c37ca320614ebac765a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:35:54 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bc394db29c70cccb4e2c37ca320614ebac765a4 --force-share --output=json" returned: 0 in 0.175s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk. size=1073741824 {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG nova.network.neutron [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Successfully created port: 798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG nova.virt.disk.api [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Cannot resize image /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk to a smaller size. {{(pid=75813) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Created local disks {{(pid=75813) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Ensure instance console log exists: /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/console.log {{(pid=75813) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG nova.network.neutron [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Successfully updated port: 798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquired lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:35:55 user nova-compute[75813]: DEBUG nova.network.neutron [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Building network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-85be1338-8be3-4f31-86e5-a11183c43469 req-22f18a47-b64d-4a3d-b4d2-63cda36118f2 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Received event network-changed-798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.compute.manager [req-85be1338-8be3-4f31-86e5-a11183c43469 req-22f18a47-b64d-4a3d-b4d2-63cda36118f2 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Refreshing instance network info cache due to event network-changed-798e0446-e28b-4f3f-84df-bd8398149706. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-85be1338-8be3-4f31-86e5-a11183c43469 req-22f18a47-b64d-4a3d-b4d2-63cda36118f2 service nova] Acquiring lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.network.neutron [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Instance cache missing network info. {{(pid=75813) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.network.neutron [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating instance_info_cache with network_info: [{"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Releasing lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.compute.manager [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Instance network_info: |[{"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75813) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-85be1338-8be3-4f31-86e5-a11183c43469 req-22f18a47-b64d-4a3d-b4d2-63cda36118f2 service nova] Acquired lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.network.neutron [req-85be1338-8be3-4f31-86e5-a11183c43469 req-22f18a47-b64d-4a3d-b4d2-63cda36118f2 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Refreshing network info cache for port 798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Start _get_guest_xml network_info=[{"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'image_id': '4d13142f-f571-4806-9713-890c0afeb458'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 13:35:56 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:35:56 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] CPU controller missing on host. {{(pid=75813) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.host [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] CPU controller found on host. {{(pid=75813) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75813) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T12:43:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T12:44:00Z,direct_url=<?>,disk_format='qcow2',id=4d13142f-f571-4806-9713-890c0afeb458,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='496b19c3bbca416b90a414b3d4c03a3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T12:44:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Flavor limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Image limits 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Flavor pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Image pref 0:0:0 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Got 1 possible topologies {{(pid=75813) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.hardware [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75813) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-519252277',display_name='tempest-SnapshotDataIntegrityTests-server-519252277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-519252277',id=53,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKN8IIsgdMX0G5MPwlGaiECW2lFf4o7mrvDFBZbFHvE9ixMcmMJYC+XNDw/tEHEBVm+TQvin6zUtvvTfj/sfynQ3kWp1GegIhlJThdg1+XkbwIm7KZrjowyyNhtwvNMVzw==',key_name='tempest-keypair-1103042333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39f1ea60311d4370a52f76e5555e80bf',ramdisk_id='',reservation_id='r-8pt6e1gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-202314546',owner_user_name='tempest-SnapshotDataIntegrityTests-202314546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:35:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f21b868974f00864a114102019d17',uuid=dd292f62-7f8f-4412-b904-cc7315b43841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75813) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Converting VIF {"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:73:05,bridge_name='br-int',has_traffic_filtering=True,id=798e0446-e28b-4f3f-84df-bd8398149706,network=Network(7b9722ac-f54e-42a7-b615-8677036f8d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798e0446-e2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.objects.instance [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'pci_devices' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] End _get_guest_xml xml=<domain type="kvm">
Nov 15 13:35:56 user nova-compute[75813]:   <uuid>dd292f62-7f8f-4412-b904-cc7315b43841</uuid>
Nov 15 13:35:56 user nova-compute[75813]:   <name>instance-00000035</name>
Nov 15 13:35:56 user nova-compute[75813]:   <memory>524288</memory>
Nov 15 13:35:56 user nova-compute[75813]:   <vcpu>1</vcpu>
Nov 15 13:35:56 user nova-compute[75813]:   <metadata>
Nov 15 13:35:56 user nova-compute[75813]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 13:35:56 user nova-compute[75813]:       <nova:package version="0.0.0"/>
Nov 15 13:35:56 user nova-compute[75813]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-519252277</nova:name>
Nov 15 13:35:56 user nova-compute[75813]:       <nova:creationTime>2023-11-15 13:35:56</nova:creationTime>
Nov 15 13:35:56 user nova-compute[75813]:       <nova:flavor name="m1.tiny">
Nov 15 13:35:56 user nova-compute[75813]:         <nova:memory>512</nova:memory>
Nov 15 13:35:56 user nova-compute[75813]:         <nova:disk>1</nova:disk>
Nov 15 13:35:56 user nova-compute[75813]:         <nova:swap>0</nova:swap>
Nov 15 13:35:56 user nova-compute[75813]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 13:35:56 user nova-compute[75813]:         <nova:vcpus>1</nova:vcpus>
Nov 15 13:35:56 user nova-compute[75813]:       </nova:flavor>
Nov 15 13:35:56 user nova-compute[75813]:       <nova:owner>
Nov 15 13:35:56 user nova-compute[75813]:         <nova:user uuid="353f21b868974f00864a114102019d17">tempest-SnapshotDataIntegrityTests-202314546-project-member</nova:user>
Nov 15 13:35:56 user nova-compute[75813]:         <nova:project uuid="39f1ea60311d4370a52f76e5555e80bf">tempest-SnapshotDataIntegrityTests-202314546</nova:project>
Nov 15 13:35:56 user nova-compute[75813]:       </nova:owner>
Nov 15 13:35:56 user nova-compute[75813]:       <nova:root type="image" uuid="4d13142f-f571-4806-9713-890c0afeb458"/>
Nov 15 13:35:56 user nova-compute[75813]:       <nova:ports>
Nov 15 13:35:56 user nova-compute[75813]:         <nova:port uuid="798e0446-e28b-4f3f-84df-bd8398149706">
Nov 15 13:35:56 user nova-compute[75813]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 13:35:56 user nova-compute[75813]:         </nova:port>
Nov 15 13:35:56 user nova-compute[75813]:       </nova:ports>
Nov 15 13:35:56 user nova-compute[75813]:     </nova:instance>
Nov 15 13:35:56 user nova-compute[75813]:   </metadata>
Nov 15 13:35:56 user nova-compute[75813]:   <sysinfo type="smbios">
Nov 15 13:35:56 user nova-compute[75813]:     <system>
Nov 15 13:35:56 user nova-compute[75813]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 13:35:56 user nova-compute[75813]:       <entry name="product">OpenStack Nova</entry>
Nov 15 13:35:56 user nova-compute[75813]:       <entry name="version">0.0.0</entry>
Nov 15 13:35:56 user nova-compute[75813]:       <entry name="serial">dd292f62-7f8f-4412-b904-cc7315b43841</entry>
Nov 15 13:35:56 user nova-compute[75813]:       <entry name="uuid">dd292f62-7f8f-4412-b904-cc7315b43841</entry>
Nov 15 13:35:56 user nova-compute[75813]:       <entry name="family">Virtual Machine</entry>
Nov 15 13:35:56 user nova-compute[75813]:     </system>
Nov 15 13:35:56 user nova-compute[75813]:   </sysinfo>
Nov 15 13:35:56 user nova-compute[75813]:   <os>
Nov 15 13:35:56 user nova-compute[75813]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 13:35:56 user nova-compute[75813]:     <boot dev="hd"/>
Nov 15 13:35:56 user nova-compute[75813]:     <smbios mode="sysinfo"/>
Nov 15 13:35:56 user nova-compute[75813]:   </os>
Nov 15 13:35:56 user nova-compute[75813]:   <features>
Nov 15 13:35:56 user nova-compute[75813]:     <acpi/>
Nov 15 13:35:56 user nova-compute[75813]:     <apic/>
Nov 15 13:35:56 user nova-compute[75813]:     <vmcoreinfo/>
Nov 15 13:35:56 user nova-compute[75813]:   </features>
Nov 15 13:35:56 user nova-compute[75813]:   <clock offset="utc">
Nov 15 13:35:56 user nova-compute[75813]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 13:35:56 user nova-compute[75813]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 13:35:56 user nova-compute[75813]:     <timer name="hpet" present="no"/>
Nov 15 13:35:56 user nova-compute[75813]:   </clock>
Nov 15 13:35:56 user nova-compute[75813]:   <cpu mode="custom" match="exact">
Nov 15 13:35:56 user nova-compute[75813]:     <model>Nehalem</model>
Nov 15 13:35:56 user nova-compute[75813]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 13:35:56 user nova-compute[75813]:   </cpu>
Nov 15 13:35:56 user nova-compute[75813]:   <devices>
Nov 15 13:35:56 user nova-compute[75813]:     <disk type="file" device="disk">
Nov 15 13:35:56 user nova-compute[75813]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 13:35:56 user nova-compute[75813]:       <source file="/opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk"/>
Nov 15 13:35:56 user nova-compute[75813]:       <target dev="vda" bus="virtio"/>
Nov 15 13:35:56 user nova-compute[75813]:     </disk>
Nov 15 13:35:56 user nova-compute[75813]:     <interface type="ethernet">
Nov 15 13:35:56 user nova-compute[75813]:       <mac address="fa:16:3e:d5:73:05"/>
Nov 15 13:35:56 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:35:56 user nova-compute[75813]:       <mtu size="1442"/>
Nov 15 13:35:56 user nova-compute[75813]:       <target dev="tap798e0446-e2"/>
Nov 15 13:35:56 user nova-compute[75813]:     </interface>
Nov 15 13:35:56 user nova-compute[75813]:     <serial type="pty">
Nov 15 13:35:56 user nova-compute[75813]:       <log file="/opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/console.log" append="off"/>
Nov 15 13:35:56 user nova-compute[75813]:     </serial>
Nov 15 13:35:56 user nova-compute[75813]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 13:35:56 user nova-compute[75813]:     <video>
Nov 15 13:35:56 user nova-compute[75813]:       <model type="virtio"/>
Nov 15 13:35:56 user nova-compute[75813]:     </video>
Nov 15 13:35:56 user nova-compute[75813]:     <rng model="virtio">
Nov 15 13:35:56 user nova-compute[75813]:       <backend model="random">/dev/urandom</backend>
Nov 15 13:35:56 user nova-compute[75813]:     </rng>
Nov 15 13:35:56 user nova-compute[75813]:     <controller type="usb" index="0" model="none"/>
Nov 15 13:35:56 user nova-compute[75813]:     <memballoon model="virtio">
Nov 15 13:35:56 user nova-compute[75813]:       <stats period="10"/>
Nov 15 13:35:56 user nova-compute[75813]:     </memballoon>
Nov 15 13:35:56 user nova-compute[75813]:   </devices>
Nov 15 13:35:56 user nova-compute[75813]: </domain>
Nov 15 13:35:56 user nova-compute[75813]:  {{(pid=75813) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-519252277',display_name='tempest-SnapshotDataIntegrityTests-server-519252277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-519252277',id=53,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKN8IIsgdMX0G5MPwlGaiECW2lFf4o7mrvDFBZbFHvE9ixMcmMJYC+XNDw/tEHEBVm+TQvin6zUtvvTfj/sfynQ3kWp1GegIhlJThdg1+XkbwIm7KZrjowyyNhtwvNMVzw==',key_name='tempest-keypair-1103042333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39f1ea60311d4370a52f76e5555e80bf',ramdisk_id='',reservation_id='r-8pt6e1gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-202314546',owner_user_name='tempest-SnapshotDataIntegrityTests-202314546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T13:35:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f21b868974f00864a114102019d17',uuid=dd292f62-7f8f-4412-b904-cc7315b43841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Converting VIF {"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:73:05,bridge_name='br-int',has_traffic_filtering=True,id=798e0446-e28b-4f3f-84df-bd8398149706,network=Network(7b9722ac-f54e-42a7-b615-8677036f8d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798e0446-e2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG os_vif [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:73:05,bridge_name='br-int',has_traffic_filtering=True,id=798e0446-e28b-4f3f-84df-bd8398149706,network=Network(7b9722ac-f54e-42a7-b615-8677036f8d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798e0446-e2') {{(pid=75813) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0de80aa1-2850-548b-a909-0b171106036d', '_type': 'linux-noop'}}, row=False) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap798e0446-e2, may_exist=True, interface_attrs={}) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap798e0446-e2, col_values=(('qos', UUID('79765209-5de3-4ac2-a97b-ed391ac3f375')),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap798e0446-e2, col_values=(('external_ids', {'iface-id': '798e0446-e28b-4f3f-84df-bd8398149706', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:73:05', 'vm-uuid': 'dd292f62-7f8f-4412-b904-cc7315b43841'}),), if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:56 user nova-compute[75813]: INFO os_vif [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:73:05,bridge_name='br-int',has_traffic_filtering=True,id=798e0446-e28b-4f3f-84df-bd8398149706,network=Network(7b9722ac-f54e-42a7-b615-8677036f8d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798e0446-e2')
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No VIF found with MAC fa:16:3e:d5:73:05, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.network.neutron [req-85be1338-8be3-4f31-86e5-a11183c43469 req-22f18a47-b64d-4a3d-b4d2-63cda36118f2 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updated VIF entry in instance network info cache for port 798e0446-e28b-4f3f-84df-bd8398149706. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG nova.network.neutron [req-85be1338-8be3-4f31-86e5-a11183c43469 req-22f18a47-b64d-4a3d-b4d2-63cda36118f2 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating instance_info_cache with network_info: [{"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:35:56 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-85be1338-8be3-4f31-86e5-a11183c43469 req-22f18a47-b64d-4a3d-b4d2-63cda36118f2 service nova] Releasing lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:35:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:57 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-22ccbb4d-f619-4a6b-82a6-3385dfe508bf req-ac92a1c8-0a76-4af4-9fd6-ca84f8c47959 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Received event network-vif-plugged-798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:35:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-22ccbb4d-f619-4a6b-82a6-3385dfe508bf req-ac92a1c8-0a76-4af4-9fd6-ca84f8c47959 service nova] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:35:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-22ccbb4d-f619-4a6b-82a6-3385dfe508bf req-ac92a1c8-0a76-4af4-9fd6-ca84f8c47959 service nova] Lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:35:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-22ccbb4d-f619-4a6b-82a6-3385dfe508bf req-ac92a1c8-0a76-4af4-9fd6-ca84f8c47959 service nova] Lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:35:58 user nova-compute[75813]: DEBUG nova.compute.manager [req-22ccbb4d-f619-4a6b-82a6-3385dfe508bf req-ac92a1c8-0a76-4af4-9fd6-ca84f8c47959 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] No waiting events found dispatching network-vif-plugged-798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:35:58 user nova-compute[75813]: WARNING nova.compute.manager [req-22ccbb4d-f619-4a6b-82a6-3385dfe508bf req-ac92a1c8-0a76-4af4-9fd6-ca84f8c47959 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Received unexpected event network-vif-plugged-798e0446-e28b-4f3f-84df-bd8398149706 for instance with vm_state building and task_state spawning.
Nov 15 13:35:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:35:58 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.compute.manager [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Instance event wait completed in 0 seconds for  {{(pid=75813) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Guest created on hypervisor {{(pid=75813) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 13:36:00 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Instance spawned successfully.
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Found default for hw_cdrom_bus of ide {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Found default for hw_disk_bus of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Found default for hw_input_bus of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Found default for hw_pointer_model of None {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Found default for hw_video_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Found default for hw_vif_model of virtio {{(pid=75813) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.compute.manager [req-ea5cecf7-149e-4ac4-8ef3-754fdbab89f7 req-c746f2ca-2162-44ba-89d9-3b912cc9eeb0 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Received event network-vif-plugged-798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ea5cecf7-149e-4ac4-8ef3-754fdbab89f7 req-c746f2ca-2162-44ba-89d9-3b912cc9eeb0 service nova] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ea5cecf7-149e-4ac4-8ef3-754fdbab89f7 req-c746f2ca-2162-44ba-89d9-3b912cc9eeb0 service nova] Lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-ea5cecf7-149e-4ac4-8ef3-754fdbab89f7 req-c746f2ca-2162-44ba-89d9-3b912cc9eeb0 service nova] Lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.compute.manager [req-ea5cecf7-149e-4ac4-8ef3-754fdbab89f7 req-c746f2ca-2162-44ba-89d9-3b912cc9eeb0 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] No waiting events found dispatching network-vif-plugged-798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:36:00 user nova-compute[75813]: WARNING nova.compute.manager [req-ea5cecf7-149e-4ac4-8ef3-754fdbab89f7 req-c746f2ca-2162-44ba-89d9-3b912cc9eeb0 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Received unexpected event network-vif-plugged-798e0446-e28b-4f3f-84df-bd8398149706 for instance with vm_state building and task_state spawning.
Nov 15 13:36:00 user nova-compute[75813]: INFO nova.compute.manager [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 15 13:36:00 user nova-compute[75813]: DEBUG nova.compute.manager [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Checking state {{(pid=75813) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 13:36:00 user nova-compute[75813]: INFO nova.compute.manager [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Took 6.38 seconds to build instance.
Nov 15 13:36:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-282dd295-0bde-456d-ad2d-c8ade4306d73 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.506s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:36:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:17 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:36:18 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:36:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:36:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:36:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:36:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:36:18 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:36:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:36:18 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating instance_info_cache with network_info: [{"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:36:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:36:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:36:19 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:36:19 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:36:21 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:36:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:25 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:36:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:36:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:36:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:36:25 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:36:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:36:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:36:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:36:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:36:25 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:36:25 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:36:25 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=24.896480560302734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:36:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:36:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:36:26 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance dd292f62-7f8f-4412-b904-cc7315b43841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:36:26 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:36:26 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:36:26 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:36:26 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:36:26 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:36:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:36:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:29 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:36:29 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:36:29 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:36:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:36:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:36:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:36:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:36:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:36:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:36:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:36:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:36:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:36:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:36:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:36:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:36:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:36:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:36:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:36:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:36:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:37:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:37:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:37:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:37:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:37:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:37:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:37:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:37:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:18 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:37:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:37:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:37:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:37:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:37:18 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:37:18 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:37:18 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating instance_info_cache with network_info: [{"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:37:18 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:37:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:37:19 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:37:21 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:37:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:37:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:37:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:37:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:37:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:37:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:37:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:22 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:37:25 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:37:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:37:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:37:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:37:25 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:37:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:25 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:25 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:37:25 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:37:25 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=24.894237518310547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:37:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:37:25 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:37:26 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance dd292f62-7f8f-4412-b904-cc7315b43841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:37:26 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:37:26 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:37:26 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:37:26 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:37:26 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:37:26 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:37:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:37:30 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:37:30 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:37:30 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:37:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:37:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:37:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:37:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:37:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:37:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-9c3b0ac8-648e-4b53-9069-514550923b40 req-709afeb7-b161-4fd7-ac7b-f396487be8a6 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Received event network-changed-798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:37:45 user nova-compute[75813]: DEBUG nova.compute.manager [req-9c3b0ac8-648e-4b53-9069-514550923b40 req-709afeb7-b161-4fd7-ac7b-f396487be8a6 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Refreshing instance network info cache due to event network-changed-798e0446-e28b-4f3f-84df-bd8398149706. {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 13:37:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c3b0ac8-648e-4b53-9069-514550923b40 req-709afeb7-b161-4fd7-ac7b-f396487be8a6 service nova] Acquiring lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:37:45 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c3b0ac8-648e-4b53-9069-514550923b40 req-709afeb7-b161-4fd7-ac7b-f396487be8a6 service nova] Acquired lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:37:45 user nova-compute[75813]: DEBUG nova.network.neutron [req-9c3b0ac8-648e-4b53-9069-514550923b40 req-709afeb7-b161-4fd7-ac7b-f396487be8a6 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Refreshing network info cache for port 798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 13:37:46 user nova-compute[75813]: DEBUG nova.network.neutron [req-9c3b0ac8-648e-4b53-9069-514550923b40 req-709afeb7-b161-4fd7-ac7b-f396487be8a6 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updated VIF entry in instance network info cache for port 798e0446-e28b-4f3f-84df-bd8398149706. {{(pid=75813) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 13:37:46 user nova-compute[75813]: DEBUG nova.network.neutron [req-9c3b0ac8-648e-4b53-9069-514550923b40 req-709afeb7-b161-4fd7-ac7b-f396487be8a6 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating instance_info_cache with network_info: [{"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:37:46 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-9c3b0ac8-648e-4b53-9069-514550923b40 req-709afeb7-b161-4fd7-ac7b-f396487be8a6 service nova] Releasing lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:37:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:37:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:37:47 user nova-compute[75813]: DEBUG nova.objects.instance [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:37:47 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:37:48 user nova-compute[75813]: INFO nova.compute.manager [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attaching volume e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 to /dev/vdb
Nov 15 13:37:48 user nova-compute[75813]: DEBUG os_brick.utils [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c78174-b04d-47d3-bed8-435878b5e712]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9c8609-163c-4dae-b6a4-1c6232ce5deb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1807c8-0019-4297-adfe-719a0e4c8262]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7504db17-84ed-4250-ad3d-8e877c67f079]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:37:48 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:37:48 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[736df830-3e04-4a06-818f-b7fbe1959101]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG os_brick.utils [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:37:48 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating existing volume attachment record: f8dd20de-3417-4101-b2df-a9a5591913ca {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:37:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgWASJmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:37:52 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:37:52 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:37:52 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ba6739-cba8-48c5-954b-e0cdb1c08d8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:37:52 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c089dbd1-2c71-4162-94d5-4ec1e7ea55bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8] added
Nov 15 13:37:52 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd1732b-6962-4f68-b41d-4a0efe39a67c]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[756ba2b7-d1c1-4a71-afd6-a3347cc3b364]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgWASJmr {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgWASJmr" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb131ae-0222-4d7c-b394-25e0dbd9db79]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QgWASJmr'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b27c706-aa69-41fa-ab48-22e39b869e34]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[80687e48-ac1c-4b81-905f-6a254ffb7805]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:37:52 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:37:52 user nova-compute[75813]:  {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:37:52 user nova-compute[75813]: WARNING os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 13:37:52 user nova-compute[75813]: 
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b43296-66f5-4546-a7bd-bcbde6c8cf18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8, portal: 172.16.0.220,3260]
Nov 15 13:37:52 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8, portal: 172.16.0.220,3260] successful.
Nov 15 13:37:52 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[94288abd-aeea-4635-a3c8-57fc3d595051]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:37:52 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da21c62-de4a-420f-ae58-97b3ed7cc590]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 (non-flash)
Nov 15 13:37:53 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 (non-flash)
Nov 15 13:37:53 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ed13f-cccd-4900-9c5c-6e343493d98a]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:37:53 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgWASJmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:37:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:37:54 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26163646462663439', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:37:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163646462663439', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:37:54 user nova-compute[75813]: DEBUG nova.objects.instance [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:37:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:37:54 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:37:54 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:37:54 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:37:54 user nova-compute[75813]:   <serial>e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8</serial>
Nov 15 13:37:54 user nova-compute[75813]: </disk>
Nov 15 13:37:54 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:37:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:37:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:37:54 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No VIF found with MAC fa:16:3e:d5:73:05, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:37:54 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-24004266-8ca6-4373-a04f-a8ffbd409281 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.451s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:37:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:37:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:38:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:38:05 user nova-compute[75813]: INFO nova.compute.manager [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Detaching volume e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8
Nov 15 13:38:06 user nova-compute[75813]: INFO nova.virt.block_device [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attempting to driver detach volume e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 from mountpoint /dev/vdb
Nov 15 13:38:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Attempting to detach device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:38:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:38:06 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:38:06 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:38:06 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:38:06 user nova-compute[75813]:   <serial>e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8</serial>
Nov 15 13:38:06 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:38:06 user nova-compute[75813]: </disk>
Nov 15 13:38:06 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:38:06 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Successfully detached device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the persistent domain config.
Nov 15 13:38:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:38:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:38:06 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:38:06 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:38:06 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:38:06 user nova-compute[75813]:   <serial>e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8</serial>
Nov 15 13:38:06 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:38:06 user nova-compute[75813]: </disk>
Nov 15 13:38:06 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:38:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:38:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:17 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:20 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:38:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:38:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:38:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:38:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:38:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:38:20 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:38:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating instance_info_cache with network_info: [{"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:38:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:38:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:38:20 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:38:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:38:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:38:23 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:38:26 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd292f62-7f8f-4412-b904-cc7315b43841 is timed out.
Nov 15 13:38:26 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Successfully detached device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the live domain config.
Nov 15 13:38:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgWASJmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:38:26 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a1dd3b-6d92-41c9-80ba-57875c79e8ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:38:26 user nova-compute[75813]: No targets found.
Nov 15 13:38:26 user nova-compute[75813]: iSNS:
Nov 15 13:38:26 user nova-compute[75813]: No targets found.
Nov 15 13:38:26 user nova-compute[75813]: STATIC:
Nov 15 13:38:26 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8
Nov 15 13:38:26 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:38:26 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:38:26 user nova-compute[75813]: FIRMWARE:
Nov 15 13:38:26 user nova-compute[75813]: No targets found.
Nov 15 13:38:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:38:26 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:38:26 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eea10bb-f136-4057-ae92-d28ea7fdcea0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0c1dc2-14a1-446b-a275-ec8e638dbb80]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 (non-flash)
Nov 15 13:38:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 (non-flash)
Nov 15 13:38:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55517cb400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80084ae-5b2c-4e71-93bc-96a483f9a2f1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e12b676-8b14-43a4-ae0a-f00a59241849]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c148f5-8d79-4894-ae67-4fddd03ec94e]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eea23c-721c-4cef-b1d3-751df67b7ac0]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e651c4-6b61-4181-b177-b90034528578]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ab14e6-e7b2-48d5-96b5-d0fd3cac0f14]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8, portal: 172.16.0.220,3260]
Nov 15 13:38:26 user nova-compute[75813]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8, portal: 172.16.0.220,3260] successful.
Nov 15 13:38:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c1d7aa-8704-48e7-88ff-8e26fdac7aa8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[17707321-d482-47d4-8e1c-d66241834a04]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== disconnect_volume: return (270ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:38:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG nova.objects.instance [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-3a34fe1e-2196-4c83-9979-827d31c49ff1 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.554s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:27 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:38:27 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:38:27 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=24.885108947753906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance dd292f62-7f8f-4412-b904-cc7315b43841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:38:27 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:38:28 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:38:28 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:38:28 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:38:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:38:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:38:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:38:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:38:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:38:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:38:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:38:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:38:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:38:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:38:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:38:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:38:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:38:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:38:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:38:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:38:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:38:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:38:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:38:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:38:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:38:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:38:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:38:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:38:58 user nova-compute[75813]: INFO nova.compute.manager [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attaching volume 39c092b1-16dd-45a1-8926-9925c0454c1b to /dev/vdb
Nov 15 13:38:58 user nova-compute[75813]: DEBUG os_brick.utils [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7bc8dc-8c7c-4440-bdde-02b2d4927724]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0972c2-f8f9-42aa-a4ff-4028dd7d432e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[923f11e1-ad0c-4831-b410-e98567a2aa62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc885b1-202a-4554-adbe-f3c4bc0c44f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:38:58 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:38:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22bd3b7-7dfa-412c-97d8-fb5422216535]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG os_brick.utils [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:38:58 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating existing volume attachment record: ab23c73b-7c8e-43bd-bc82-72e3d96c613e {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:39:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiQETVJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:39:02 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:39:02 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:39:02 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dcb726-3b3e-4669-8833-4759dcdc0d61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:39:02 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[26131239-007e-490c-b758-850c75dd58b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b] added
Nov 15 13:39:02 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c53d824-2eb1-44c8-8ce0-345a0e61a61d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed46b1c-f41e-4643-a453-d78f4963430b]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiQETVJs {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiQETVJs" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cf9bc9-6098-4cc6-9c11-a9384e36843d]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xiQETVJs'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c56905-46a3-478f-ad53-7e618f4247bf]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a832205c-cdd7-4cd2-a8d2-a20758ee1814]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:39:02 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:39:02 user nova-compute[75813]:  {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:39:02 user nova-compute[75813]: WARNING os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 13:39:02 user nova-compute[75813]: 
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57807bf-b6f3-4650-a8d9-3524edf27927]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b, portal: 172.16.0.220,3260]
Nov 15 13:39:02 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b, portal: 172.16.0.220,3260] successful.
Nov 15 13:39:02 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:39:02 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83a660e-1d7c-4532-b979-32db7c9ad48a]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5886f561-a7ff-476f-b3fe-ad1dedf96973]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b (non-flash)
Nov 15 13:39:03 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b (non-flash)
Nov 15 13:39:03 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a99b6f-6cc1-4681-acc6-5be0d6bb4b10]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:39:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiQETVJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:39:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:39:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23662313435643434', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:39:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662313435643434', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:39:04 user nova-compute[75813]: DEBUG nova.objects.instance [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:39:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:39:04 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:39:04 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:39:04 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:39:04 user nova-compute[75813]:   <serial>39c092b1-16dd-45a1-8926-9925c0454c1b</serial>
Nov 15 13:39:04 user nova-compute[75813]: </disk>
Nov 15 13:39:04 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:39:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:39:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:39:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No VIF found with MAC fa:16:3e:d5:73:05, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:39:04 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-d959a708-33cc-4592-91ab-56e69d6d7f42 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.262s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:39:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:39:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:39:06 user nova-compute[75813]: INFO nova.compute.manager [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Detaching volume 39c092b1-16dd-45a1-8926-9925c0454c1b
Nov 15 13:39:06 user nova-compute[75813]: INFO nova.virt.block_device [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attempting to driver detach volume 39c092b1-16dd-45a1-8926-9925c0454c1b from mountpoint /dev/vdb
Nov 15 13:39:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Attempting to detach device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:39:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:39:06 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:39:06 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:39:06 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:39:06 user nova-compute[75813]:   <serial>39c092b1-16dd-45a1-8926-9925c0454c1b</serial>
Nov 15 13:39:06 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:39:06 user nova-compute[75813]: </disk>
Nov 15 13:39:06 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:39:06 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Successfully detached device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the persistent domain config.
Nov 15 13:39:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:39:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:39:06 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:39:06 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:39:06 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:39:06 user nova-compute[75813]:   <serial>39c092b1-16dd-45a1-8926-9925c0454c1b</serial>
Nov 15 13:39:06 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:39:06 user nova-compute[75813]: </disk>
Nov 15 13:39:06 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:39:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:39:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:39:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:39:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:39:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:39:18 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:18 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75813) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 13:39:20 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:39:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:39:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:39:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:39:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:39:20 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:39:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating instance_info_cache with network_info: [{"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:39:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:39:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:39:20 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:39:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:39:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:39:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:39:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:39:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:39:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:23 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:39:24 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:39:26 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd292f62-7f8f-4412-b904-cc7315b43841 is timed out.
Nov 15 13:39:26 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Successfully detached device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the live domain config.
Nov 15 13:39:26 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiQETVJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:39:26 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:39:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eff676-b751-41d5-9ce0-dea4f4f749d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:39:26 user nova-compute[75813]: No targets found.
Nov 15 13:39:26 user nova-compute[75813]: iSNS:
Nov 15 13:39:26 user nova-compute[75813]: No targets found.
Nov 15 13:39:26 user nova-compute[75813]: STATIC:
Nov 15 13:39:26 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b
Nov 15 13:39:26 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:39:26 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:39:26 user nova-compute[75813]: FIRMWARE:
Nov 15 13:39:26 user nova-compute[75813]: No targets found.
Nov 15 13:39:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:39:26 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:39:26 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ee9112-1db5-4cdd-beb7-69c9135d3c82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[be36faf0-ce49-4cd8-8ff3-e3424965b34c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b (non-flash)
Nov 15 13:39:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:39:26 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b (non-flash)
Nov 15 13:39:26 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f55482d6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca101ef1-3622-4a74-97b9-e1eb1a595fd8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d10c0b-1528-40a7-9f3d-197c41add7d9]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5639f88-9c88-4b51-bb88-b0fde1465f04]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[175c6811-6a9b-4949-82dd-04164efd5242]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ab3415-b850-4064-bfcc-00409df6ac43]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5c194e-b27b-4893-9ecb-5ec6f26f1c18]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b, portal: 172.16.0.220,3260]
Nov 15 13:39:27 user nova-compute[75813]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b, portal: 172.16.0.220,3260] successful.
Nov 15 13:39:27 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39c092b1-16dd-45a1-8926-9925c0454c1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca70bb-b1d4-47ba-b19a-0578ae276df8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== disconnect_volume: return (315ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:27 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:39:27 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:39:27 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=24.88420867919922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:39:27 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c5e1a825-36cd-4b3a-a718-b853467fab13 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.747s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance dd292f62-7f8f-4412-b904-cc7315b43841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing inventories for resource provider 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating ProviderTree inventory for provider 55ef6276-ce17-4a96-a641-e38882572693 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Updating inventory in ProviderTree for provider 55ef6276-ce17-4a96-a641-e38882572693 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing aggregate associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, aggregates: None {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Refreshing trait associations for resource provider 55ef6276-ce17-4a96-a641-e38882572693, traits: HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75813) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Cleaning up deleted instances {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 13:39:28 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] There are 0 instances to clean {{(pid=75813) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 13:39:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:39:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:33 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:34 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:39:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:39:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:39:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:39:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:39:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:39:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:39:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:39:48 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:39:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:39:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:39:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:39:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:39:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:39:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:39:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:39:58 user nova-compute[75813]: INFO nova.compute.manager [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attaching volume ae8eda8b-d863-4c5d-9463-072049851253 to /dev/vdb
Nov 15 13:39:58 user nova-compute[75813]: DEBUG os_brick.utils [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b2dcba-aeed-497e-8f7e-b390e95d08b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1aa76b-b4d5-4164-8c78-2206aa6db12d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6c8999-bfd7-4e8e-bc28-bf727d449171]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77cc1c1-a7c6-4c03-a079-eb6ccead4840]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:39:58 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:39:58 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2495484-357b-4f9a-bb27-5a7fa15bb0f9]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG os_brick.utils [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:39:58 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating existing volume attachment record: 9205721e-2fa7-48cd-a0be-c8dd6e5ab31b {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:40:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRqhcxzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:40:03 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:40:03 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:40:03 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44fd9ec-04e0-49bf-bf44-ca14bcb1a1d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:40:03 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0389e6df-eb72-40a9-8e8d-becd2b5d0a4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253] added
Nov 15 13:40:03 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c8c62c-b967-43db-b3ef-3282f404aa51]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5162ab-5a89-4b1a-80bd-d50645155933]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRqhcxzr {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRqhcxzr" returned: 0 in 0.032s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b38eb1e-0e9a-4b16-8966-4641d0c267da]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lRqhcxzr'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[25df4739-2418-4e16-b852-267203c1dc12]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bf018d-5df2-41a8-9d06-8efc8c576330]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:40:03 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:40:03 user nova-compute[75813]:  {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:40:03 user nova-compute[75813]: WARNING os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 13:40:03 user nova-compute[75813]: 
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfef1143-6520-414d-8ff0-8c1f2911c11f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253, portal: 172.16.0.220,3260]
Nov 15 13:40:03 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253, portal: 172.16.0.220,3260] successful.
Nov 15 13:40:03 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa771d0-bb75-4760-b28e-56001810f832]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[67080765-871f-4797-a6db-749539da46d5]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 (non-flash)
Nov 15 13:40:03 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 (non-flash)
Nov 15 13:40:03 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3737ee42-8eeb-4124-97c1-a5d13127df1a]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:03 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:40:04 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:40:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRqhcxzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:40:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:40:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23765613462653439', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:40:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765613462653439', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:40:04 user nova-compute[75813]: DEBUG nova.objects.instance [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:40:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:40:04 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:40:04 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:40:04 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:40:04 user nova-compute[75813]:   <serial>ae8eda8b-d863-4c5d-9463-072049851253</serial>
Nov 15 13:40:04 user nova-compute[75813]: </disk>
Nov 15 13:40:04 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:40:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:40:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:40:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No VIF found with MAC fa:16:3e:d5:73:05, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:40:05 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-c8bf5247-4e2b-4275-8207-2e3684cf5e55 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.446s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:40:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:40:07 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:40:07 user nova-compute[75813]: INFO nova.compute.manager [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Detaching volume ae8eda8b-d863-4c5d-9463-072049851253
Nov 15 13:40:07 user nova-compute[75813]: INFO nova.virt.block_device [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attempting to driver detach volume ae8eda8b-d863-4c5d-9463-072049851253 from mountpoint /dev/vdb
Nov 15 13:40:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Attempting to detach device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:40:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:40:07 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:40:07 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:40:07 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:40:07 user nova-compute[75813]:   <serial>ae8eda8b-d863-4c5d-9463-072049851253</serial>
Nov 15 13:40:07 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:40:07 user nova-compute[75813]: </disk>
Nov 15 13:40:07 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:40:07 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Successfully detached device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the persistent domain config.
Nov 15 13:40:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:40:07 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:40:07 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:40:07 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:40:07 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:40:07 user nova-compute[75813]:   <serial>ae8eda8b-d863-4c5d-9463-072049851253</serial>
Nov 15 13:40:07 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:40:07 user nova-compute[75813]: </disk>
Nov 15 13:40:07 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:40:08 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:40:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:20 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:40:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:40:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:40:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:40:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:40:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:40:20 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:40:20 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating instance_info_cache with network_info: [{"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:40:20 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:40:20 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:40:21 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:40:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:40:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:40:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:40:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:40:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:40:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:24 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:40:25 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:40:25 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:40:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:40:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:40:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:40:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:40:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd292f62-7f8f-4412-b904-cc7315b43841 is timed out.
Nov 15 13:40:28 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Successfully detached device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the live domain config.
Nov 15 13:40:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRqhcxzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:40:28 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[47989481-4c36-4098-9d46-984ded70ee55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:40:28 user nova-compute[75813]: No targets found.
Nov 15 13:40:28 user nova-compute[75813]: iSNS:
Nov 15 13:40:28 user nova-compute[75813]: No targets found.
Nov 15 13:40:28 user nova-compute[75813]: STATIC:
Nov 15 13:40:28 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253
Nov 15 13:40:28 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:40:28 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:40:28 user nova-compute[75813]: FIRMWARE:
Nov 15 13:40:28 user nova-compute[75813]: No targets found.
Nov 15 13:40:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:40:28 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:40:28 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7fed69-5fc9-4fa6-b77b-a7ce03d0ffea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c1571-ceb9-4ebc-8784-75af5c75ea4b]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 (non-flash)
Nov 15 13:40:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 (non-flash)
Nov 15 13:40:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5530609630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e6bd35-1cc1-440c-9053-35a6d17450af]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c75455-59f2-4de6-801f-a08de33e6056]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa7154f-8b32-4180-9466-4a55b75c1795]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0d19dd-93ac-4087-8c09-ea797a1b7040]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d3f07e-611b-46af-a4a9-29ae98b113f8]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b72b96-95a8-490e-8148-7735cc1a22c0]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253, portal: 172.16.0.220,3260]
Nov 15 13:40:28 user nova-compute[75813]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253, portal: 172.16.0.220,3260] successful.
Nov 15 13:40:28 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8eda8b-d863-4c5d-9463-072049851253 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[91326423-67b2-45e4-97dc-28c5458682bb]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== disconnect_volume: return (340ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:40:28 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:40:28 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:40:28 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=24.883228302001953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:40:28 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:40:29 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance dd292f62-7f8f-4412-b904-cc7315b43841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:40:29 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:40:29 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:40:29 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:40:29 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:40:29 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:40:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:40:29 user nova-compute[75813]: DEBUG nova.objects.instance [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:40:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-eec3ab76-3f03-4b82-ba32-13323e0d1e29 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.711s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:40:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:40:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:40:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:40:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:40:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:40:34 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:40:34 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:40:34 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:40:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:40:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:40:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:40:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:40:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:40:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:40:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:40:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:40:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:40:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:40:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:40:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:40:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:40:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:40:59 user nova-compute[75813]: DEBUG nova.objects.instance [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:40:59 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:41:00 user nova-compute[75813]: INFO nova.compute.manager [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attaching volume ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 to /dev/vdb
Nov 15 13:41:00 user nova-compute[75813]: DEBUG os_brick.utils [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4475918f-f7a8-4d32-ae20-db03310a2fc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:92da8cdbffec\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6e8d74-94b8-4ed5-8e8b-53dcd21f00a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2a9aa6-98f6-4514-b3e4-aaff17239aef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5d2014-d4ed-4444-b595-b6ed30ef59ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Running cmd (subprocess): nvme version {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] 'nvme version' failed. Not Retrying. {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] nvme not present on system {{(pid=75813) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 13:41:00 user nova-compute[75813]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 13:41:00 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31afc6d-db94-4e4a-88a7-33dba016cd32]: (4, '') {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75813) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.lightos [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] LIGHTOS: no hostnqn found. {{(pid=75813) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG os_brick.utils [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:92da8cdbffec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:41:00 user nova-compute[75813]: DEBUG nova.virt.block_device [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating existing volume attachment record: ff9ad539-9c18-428d-8d6e-42280fb6cf99 {{(pid=75813) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 13:41:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:41:02 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Calling os-brick to attach iSCSI Volume {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObgYnvFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:41:04 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:41:04 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:41:04 user nova-compute[75813]: INFO os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[44435721-374f-4208-a12f-2b1cd6a7c8ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 13:41:04 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --interface default --op new {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b5f439-51dd-4c16-a82f-200b4be214f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0] added\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0] added
Nov 15 13:41:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff0aa7a-2e86-42f0-a4eb-eeb2bae4ae08]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[935ba2e0-ce74-41e5-a873-2a0a81ab07db]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ObgYnvFa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ObgYnvFa" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb553eb-b6c0-4f7d-bcd6-9bb28efc6378]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ObgYnvFa'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b785bbe-4a89-45d0-915c-267a70618590]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[1473f8fa-685e-426f-b373-95f09a9efdcd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:41:04 user nova-compute[75813]:  {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 13:41:04 user nova-compute[75813]:  {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:41:04 user nova-compute[75813]: WARNING os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 13:41:04 user nova-compute[75813]: 
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --login {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b45c2d-81ee-4205-9137-799753149d74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0, portal: 172.16.0.220,3260]
Nov 15 13:41:04 user nova-compute[75813]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0, portal: 172.16.0.220,3260] successful.
Nov 15 13:41:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb747e-fea1-48b1-95e1-47c8d40a18a4]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[838562a6-bc34-44d0-89af-0e8a528f0f83]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 (non-flash)
Nov 15 13:41:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 (non-flash)
Nov 15 13:41:04 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Connected to 172.16.0.220:3260 {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75813) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75813) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f63ad38-aab0-4c0f-b637-6a4e36b8bfb2]: (4, ('- - 0', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75813) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 13:41:04 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObgYnvFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75813) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 13:41:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:41:05 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23063653337633234', 'path': '/dev/sdb'} {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:41:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063653337633234', 'path': '/dev/sdb'} {{(pid=75813) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 13:41:05 user nova-compute[75813]: DEBUG nova.objects.instance [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:41:05 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 13:41:05 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:41:05 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:41:05 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:41:05 user nova-compute[75813]:   <serial>ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0</serial>
Nov 15 13:41:05 user nova-compute[75813]: </disk>
Nov 15 13:41:05 user nova-compute[75813]:  {{(pid=75813) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 13:41:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:41:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75813) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 13:41:06 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] No VIF found with MAC fa:16:3e:d5:73:05, not building metadata {{(pid=75813) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 13:41:06 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-0263a37f-c699-4aa5-9357-7e4136a80669 tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.461s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:41:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:41:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:41:09 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:41:09 user nova-compute[75813]: INFO nova.compute.manager [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Detaching volume ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0
Nov 15 13:41:09 user nova-compute[75813]: INFO nova.virt.block_device [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Attempting to driver detach volume ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 from mountpoint /dev/vdb
Nov 15 13:41:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Attempting to detach device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the persistent domain config. {{(pid=75813) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 13:41:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:41:09 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:41:09 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:41:09 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:41:09 user nova-compute[75813]:   <serial>ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0</serial>
Nov 15 13:41:09 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:41:09 user nova-compute[75813]: </disk>
Nov 15 13:41:09 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:41:09 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Successfully detached device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the persistent domain config.
Nov 15 13:41:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the live domain config. {{(pid=75813) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 13:41:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.guest [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 13:41:09 user nova-compute[75813]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 13:41:09 user nova-compute[75813]:   <source dev="/dev/sdb"/>
Nov 15 13:41:09 user nova-compute[75813]:   <target dev="vdb" bus="virtio"/>
Nov 15 13:41:09 user nova-compute[75813]:   <serial>ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0</serial>
Nov 15 13:41:09 user nova-compute[75813]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 13:41:09 user nova-compute[75813]: </disk>
Nov 15 13:41:09 user nova-compute[75813]:  {{(pid=75813) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 13:41:09 user nova-compute[75813]: DEBUG nova.virt.libvirt.driver [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 13:41:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:41:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:41:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:41:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:41:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:41:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:41:12 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:41:16 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquired lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Forcefully refreshing network info cache for instance {{(pid=75813) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG nova.objects.instance [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lazy-loading 'info_cache' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG nova.network.neutron [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating instance_info_cache with network_info: [{"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Releasing lock "refresh_cache-dd292f62-7f8f-4412-b904-cc7315b43841" {{(pid=75813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updated the network info_cache for instance {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:41:21 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:41:26 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:41:26 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:41:27 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:41:27 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75813) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:29 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd292f62-7f8f-4412-b904-cc7315b43841 is timed out.
Nov 15 13:41:29 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Successfully detached device vdb from instance dd292f62-7f8f-4412-b904-cc7315b43841 from the live domain config.
Nov 15 13:41:29 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:41:29 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:41:29 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=24.882305145263672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] calling os-brick to detach iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f555033f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObgYnvFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 13:41:29 user nova-compute[75813]: WARNING os_brick.initiator.connectors.base [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 13:41:29 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b879cb-2bff-40ea-b8ec-10da0c302ecc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 13:41:29 user nova-compute[75813]: No targets found.
Nov 15 13:41:29 user nova-compute[75813]: iSNS:
Nov 15 13:41:29 user nova-compute[75813]: No targets found.
Nov 15 13:41:29 user nova-compute[75813]: STATIC:
Nov 15 13:41:29 user nova-compute[75813]: Target: iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0
Nov 15 13:41:29 user nova-compute[75813]:         Portal: 172.16.0.220:3260,-1
Nov 15 13:41:29 user nova-compute[75813]:                 Iface Name: default
Nov 15 13:41:29 user nova-compute[75813]: FIRMWARE:
Nov 15 13:41:29 user nova-compute[75813]: No targets found.
Nov 15 13:41:29 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 13:41:29 user nova-compute[75813]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 13:41:29 user nova-compute[75813]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75813) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0', 0)] {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cffbb0-8261-4a97-b3d4-4715a1db8800]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:29 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f825cf-1e87-45c9-836d-6f6cb3377cd1]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 (non-flash)\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 (non-flash)
Nov 15 13:41:30 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 (non-flash)
Nov 15 13:41:30 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f553060bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0'): ({'sdb'}, set())}) {{(pid=75813) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Removing single pathed devices sdb {{(pid=75813) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Instance dd292f62-7f8f-4412-b904-cc7315b43841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75813) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[38031b9d-9903-4421-b845-79f25e86bd22]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f9e90b-35bd-4a2a-b67f-b335974b2426]: (4, ('ok\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Flushing IO for device /dev/sdb {{(pid=75813) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4961f99-c0e9-434c-a734-61cf396e3723]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75813) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7a9e01-0dd7-4678-ad8b-cf1806b9644a]: (4, ('1', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.linuxscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] SCSI volumes sdb have been removed. {{(pid=75813) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0')] {{(pid=75813) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.046s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[256183e4-e3b7-488c-810e-ce49bd2f4111]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --logout {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[c950c8fe-52d1-4c03-bc6e-b6b2f64384b6]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0, portal: 172.16.0.220,3260]
Nov 15 13:41:30 user nova-compute[75813]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0, portal: 172.16.0.220,3260] successful.
Nov 15 13:41:30 user nova-compute[75813]:  stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op delete {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce1e4b86-2fd9-4b54-96ab-afb1f1cbfca0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5d034e-eeb2-4d95-bf57-98842e3df8ff]: (4, ('', '')) {{(pid=87167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75813) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.base [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] <== disconnect_volume: return (349ms) None {{(pid=75813) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Disconnected iSCSI Volume {{(pid=75813) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 13:41:30 user nova-compute[75813]: DEBUG nova.objects.instance [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'flavor' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:41:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-89fad4ff-0e42-437c-9026-aa94846f063c tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.774s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:41:31 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:41:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:41:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:41:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:41:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:41:36 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:41:41 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:41:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:41:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:41:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:41:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:41:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:41:46 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:41:51 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:41:56 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:42:01 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:42:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:42:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:42:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:42:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:42:06 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:42:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:42:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:42:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:42:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:42:14 user nova-compute[75813]: INFO nova.compute.manager [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Terminating instance
Nov 15 13:42:14 user nova-compute[75813]: DEBUG nova.compute.manager [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Start destroying the instance on the hypervisor. {{(pid=75813) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-df4b7121-f88a-4c6d-97e4-39c7d52a7558 req-9566bd0b-9e54-4a5f-bb78-66d8fd147cf8 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Received event network-vif-unplugged-798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-df4b7121-f88a-4c6d-97e4-39c7d52a7558 req-9566bd0b-9e54-4a5f-bb78-66d8fd147cf8 service nova] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-df4b7121-f88a-4c6d-97e4-39c7d52a7558 req-9566bd0b-9e54-4a5f-bb78-66d8fd147cf8 service nova] Lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-df4b7121-f88a-4c6d-97e4-39c7d52a7558 req-9566bd0b-9e54-4a5f-bb78-66d8fd147cf8 service nova] Lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-df4b7121-f88a-4c6d-97e4-39c7d52a7558 req-9566bd0b-9e54-4a5f-bb78-66d8fd147cf8 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] No waiting events found dispatching network-vif-unplugged-798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG nova.compute.manager [req-df4b7121-f88a-4c6d-97e4-39c7d52a7558 req-9566bd0b-9e54-4a5f-bb78-66d8fd147cf8 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Received event network-vif-unplugged-798e0446-e28b-4f3f-84df-bd8398149706 for instance with task_state deleting. {{(pid=75813) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:14 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [-] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Instance destroyed successfully.
Nov 15 13:42:15 user nova-compute[75813]: DEBUG nova.objects.instance [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lazy-loading 'resources' on Instance uuid dd292f62-7f8f-4412-b904-cc7315b43841 {{(pid=75813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG nova.virt.libvirt.vif [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T13:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-519252277',display_name='tempest-SnapshotDataIntegrityTests-server-519252277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-519252277',id=53,image_ref='4d13142f-f571-4806-9713-890c0afeb458',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKN8IIsgdMX0G5MPwlGaiECW2lFf4o7mrvDFBZbFHvE9ixMcmMJYC+XNDw/tEHEBVm+TQvin6zUtvvTfj/sfynQ3kWp1GegIhlJThdg1+XkbwIm7KZrjowyyNhtwvNMVzw==',key_name='tempest-keypair-1103042333',keypairs=<?>,launch_index=0,launched_at=2023-11-15T13:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39f1ea60311d4370a52f76e5555e80bf',ramdisk_id='',reservation_id='r-8pt6e1gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d13142f-f571-4806-9713-890c0afeb458',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-202314546',owner_user_name='tempest-SnapshotDataIntegrityTests-202314546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T13:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353f21b868974f00864a114102019d17',uuid=dd292f62-7f8f-4412-b904-cc7315b43841,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Converting VIF {"id": "798e0446-e28b-4f3f-84df-bd8398149706", "address": "fa:16:3e:d5:73:05", "network": {"id": "7b9722ac-f54e-42a7-b615-8677036f8d2b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-649987457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f1ea60311d4370a52f76e5555e80bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798e0446-e2", "ovs_interfaceid": "798e0446-e28b-4f3f-84df-bd8398149706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG nova.network.os_vif_util [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:73:05,bridge_name='br-int',has_traffic_filtering=True,id=798e0446-e28b-4f3f-84df-bd8398149706,network=Network(7b9722ac-f54e-42a7-b615-8677036f8d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798e0446-e2') {{(pid=75813) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG os_vif [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:73:05,bridge_name='br-int',has_traffic_filtering=True,id=798e0446-e28b-4f3f-84df-bd8398149706,network=Network(7b9722ac-f54e-42a7-b615-8677036f8d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798e0446-e2') {{(pid=75813) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap798e0446-e2, bridge=br-int, if_exists=True) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79765209-5de3-4ac2-a97b-ed391ac3f375) {{(pid=75813) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:42:15 user nova-compute[75813]: INFO os_vif [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:73:05,bridge_name='br-int',has_traffic_filtering=True,id=798e0446-e28b-4f3f-84df-bd8398149706,network=Network(7b9722ac-f54e-42a7-b615-8677036f8d2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798e0446-e2')
Nov 15 13:42:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Deleting instance files /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841_del
Nov 15 13:42:15 user nova-compute[75813]: INFO nova.virt.libvirt.driver [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Deletion of /opt/stack/data/nova/instances/dd292f62-7f8f-4412-b904-cc7315b43841_del complete
Nov 15 13:42:15 user nova-compute[75813]: INFO nova.compute.manager [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 13:42:15 user nova-compute[75813]: DEBUG oslo.service.loopingcall [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75813) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG nova.compute.manager [-] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Deallocating network for instance {{(pid=75813) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] deallocate_for_instance() {{(pid=75813) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG nova.network.neutron [-] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Updating instance_info_cache with network_info: [] {{(pid=75813) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 13:42:15 user nova-compute[75813]: INFO nova.compute.manager [-] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Took 0.67 seconds to deallocate network for instance.
Nov 15 13:42:15 user nova-compute[75813]: DEBUG nova.compute.manager [req-ec02d21c-68cd-4073-b811-bf4201df1e8e req-f533a884-e8a0-452e-811d-d1ef442bb863 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Received event network-vif-deleted-798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:42:15 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:42:16 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:42:16 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:42:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:42:16 user nova-compute[75813]: INFO nova.scheduler.client.report [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Deleted allocations for instance dd292f62-7f8f-4412-b904-cc7315b43841
Nov 15 13:42:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-4aad98ac-3523-4c2f-bb3b-6d431c78353e tempest-SnapshotDataIntegrityTests-202314546 tempest-SnapshotDataIntegrityTests-202314546-project-member] Lock "dd292f62-7f8f-4412-b904-cc7315b43841" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:42:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-28d45dd1-aa03-4afa-96d4-b4f125970ef6 req-4bd2d9fb-c28d-4ccd-9647-2b419d364104 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Received event network-vif-plugged-798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 13:42:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-28d45dd1-aa03-4afa-96d4-b4f125970ef6 req-4bd2d9fb-c28d-4ccd-9647-2b419d364104 service nova] Acquiring lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:42:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-28d45dd1-aa03-4afa-96d4-b4f125970ef6 req-4bd2d9fb-c28d-4ccd-9647-2b419d364104 service nova] Lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:42:16 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [req-28d45dd1-aa03-4afa-96d4-b4f125970ef6 req-4bd2d9fb-c28d-4ccd-9647-2b419d364104 service nova] Lock "dd292f62-7f8f-4412-b904-cc7315b43841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:42:16 user nova-compute[75813]: DEBUG nova.compute.manager [req-28d45dd1-aa03-4afa-96d4-b4f125970ef6 req-4bd2d9fb-c28d-4ccd-9647-2b419d364104 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] No waiting events found dispatching network-vif-plugged-798e0446-e28b-4f3f-84df-bd8398149706 {{(pid=75813) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 13:42:16 user nova-compute[75813]: WARNING nova.compute.manager [req-28d45dd1-aa03-4afa-96d4-b4f125970ef6 req-4bd2d9fb-c28d-4ccd-9647-2b419d364104 service nova] [instance: dd292f62-7f8f-4412-b904-cc7315b43841] Received unexpected event network-vif-plugged-798e0446-e28b-4f3f-84df-bd8398149706 for instance with vm_state deleted and task_state None.
Nov 15 13:42:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:21 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:42:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:42:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:42:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 13:42:23 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:42:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:42:26 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:42:27 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:42:27 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:42:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:42:31 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:42:31 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:42:31 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9143MB free_disk=24.90935516357422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:42:31 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:42:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:42:35 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:42:35 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:42:37 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:42:37 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:42:37 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:42:40 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:42:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:42:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:42:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:42:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:42:45 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:50 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:42:55 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:43:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:43:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:43:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:43:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:43:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:43:00 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:43:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:43:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:43:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:43:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:43:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:43:05 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:43:07 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:43:08 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:43:10 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:43:11 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:43:15 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:43:20 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:43:21 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:43:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Starting heal instance info cache {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 13:43:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Rebuilding the list of instances to heal {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 13:43:21 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Didn't find any instances for network info cache update. {{(pid=75813) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 13:43:25 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:43:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:43:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:43:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75813) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 13:43:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:43:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75813) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 13:43:25 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 13:43:27 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:43:27 user nova-compute[75813]: DEBUG nova.compute.manager [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75813) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 13:43:28 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:43:30 user nova-compute[75813]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75813) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 13:43:31 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG oslo_service.periodic_task [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75813) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Auditing locally available compute resources for user (node: user) {{(pid=75813) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 13:43:32 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:43:32 user nova-compute[75813]: WARNING nova.virt.libvirt.driver [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 13:43:32 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Hypervisor/Node resource view: name=user free_ram=9261MB free_disk=24.87247085571289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75813) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75813) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG nova.compute.provider_tree [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed in ProviderTree for provider: 55ef6276-ce17-4a96-a641-e38882572693 {{(pid=75813) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG nova.scheduler.client.report [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Inventory has not changed for provider 55ef6276-ce17-4a96-a641-e38882572693 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75813) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG nova.compute.resource_tracker [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Compute_service record updated for user:user {{(pid=75813) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 13:43:32 user nova-compute[75813]: DEBUG oslo_concurrency.lockutils [None req-410e9c44-43fa-4be6-afaf-5a1f34c27596 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=75813) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}